Sep 11 18:15:57.316618 ip-10-0-138-165 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 18:15:57.677723 ip-10-0-138-165 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:15:57.677723 ip-10-0-138-165 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 18:15:57.677723 ip-10-0-138-165 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:15:57.677723 ip-10-0-138-165 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 18:15:57.677723 ip-10-0-138-165 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:15:57.679328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.679213    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 18:15:57.684060 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684038    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:15:57.684060 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684055    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:15:57.684060 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684062    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:15:57.684060 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684067    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684072    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684076    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684081    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684085    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684089    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684093    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684096    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684100    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684105    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684109    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684113    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684117    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684120    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684124    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684135    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684140    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684144    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684148    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684151    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:15:57.684296 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684155    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684159    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684163    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684167    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684171    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684175    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684179    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684184    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684187    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684192    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684196    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684200    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684205    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684209    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684214    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684218    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684222    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684227    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684231    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684236    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:15:57.685261 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684240    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684244    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684248    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684253    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684256    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684260    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684265    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684269    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684274    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684278    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684283    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684287    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684291    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684295    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684317    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684322    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684326    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684333    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684339    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684345    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:15:57.686178 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684349    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684355    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684359    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684364    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684370    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684374    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684379    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684384    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684389    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684396    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684400    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684405    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684409    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684413    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684417    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684421    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684425    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684430    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684434    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:15:57.686687 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684438    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684442    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684447    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684452    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684456    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684460    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684464    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684471    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684479    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684485    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684490    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684495    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684499    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684504    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684508    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684514    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.684520    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685673    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685683    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:15:57.687149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685688    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685693    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685698    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685702    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685706    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685711    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685715    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685720    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685724    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685729    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685734    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685738    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685742    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685746    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685750    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685754    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685762    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685768    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685773    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:15:57.687778 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685778    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685783    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685787    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685791    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685795    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685800    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685804    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685808    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685812    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685817    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685821    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685825    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685831    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685835    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685840    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685845    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685849    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685853    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685857    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:15:57.688513 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685861    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685866    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685870    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685873    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685877    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685881    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685886    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685890    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685894    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685899    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685903    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685908    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685912    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685916    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685920    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685924    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685929    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685933    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685937    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685941    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:15:57.688977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685947    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685952    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685957    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685961    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685965    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685969    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685974    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685978    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685981    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685985    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685990    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685994    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.685998    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686002    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686006    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686011    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686016    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686021    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686026    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686031    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:15:57.689498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686035    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686039    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686044    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686048    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686057    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686062    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686068    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686072    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686076    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686081    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686085    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686089    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686094    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686098    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686103    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686107    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686111    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686116    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686122    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:15:57.689992 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686583    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686594    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686598    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686602    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686605    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686608    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686612    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686616    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686620    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686622    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686625    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686628    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686631    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686633    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686636    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686639    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686642    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686644    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686647    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686650    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:15:57.690480 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686669    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686673    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686676    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686679    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686682    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686685    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686688    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686692    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686695    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686698    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686701    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686704    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686708    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686712    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686715    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686717    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686720    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686723    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686727    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:15:57.690987 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686730    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686733    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686737    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686740    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686743    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686745    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686748    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686750    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686753    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686756    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686758    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686761    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686764    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686767    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686769    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686772    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686774    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686777    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686779    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686782    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:15:57.691478 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686785    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686787    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686790    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686792    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686795    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686798    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686801    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686804    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686808    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686812    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686815    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686818    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686823    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686826    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686828    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686831    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686834    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686837    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686839    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:15:57.691955 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686842    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686845    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686847    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686850    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686852    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686855    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686857    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686860    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686862    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686865    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686867    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686870    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686873    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686875    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686878    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686880    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686883    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686885    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686888    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686891    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:15:57.692479 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.686894    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.686973    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687015    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687021    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687026    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687030    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687033    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687038    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687042    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687045    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687049    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687052    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687056    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687059    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687062    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687065    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687068    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687071    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687074    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687078    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687081    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687084    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687087    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687091    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 18:15:57.692961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687094    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687098    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687101    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687104    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687107    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687110    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687114    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687119    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687122    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687127    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687130    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687133    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687136    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687139    2561 flags.go:64] FLAG: --enable-server="true"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687142    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687147    2561 flags.go:64] FLAG: --event-burst="100"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687150    2561 flags.go:64] FLAG: --event-qps="50"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687153    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687157    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687160    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687164    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687167    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687170    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687173    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687176    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 18:15:57.693595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687179    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687182    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687185    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687188    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687191    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687194    2561 flags.go:64] FLAG: --feature-gates=""
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687198    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687201    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687204    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687207    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687210    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687213    2561 flags.go:64] FLAG: --help="false"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687216    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-165.ec2.internal"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687219    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687224    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687227    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687230    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687234    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687237    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687240    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687243    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687246    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687248    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687252    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 18:15:57.694212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687254    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687257    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687260    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687263    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687266    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687269    2561 flags.go:64] FLAG: --lock-file=""
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687272    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687275    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687278    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687283    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687286    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687289    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687292    2561 flags.go:64] FLAG: --logging-format="text"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687294    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687313    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687317    2561 flags.go:64] FLAG: --manifest-url=""
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687320    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687324    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687327    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687331    2561 flags.go:64] FLAG: --max-pods="110"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687335    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687338    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687343    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687346    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687349    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 18:15:57.694823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687352    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687392    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687444    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687449    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687453    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687457    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687461    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687467    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687470    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687478    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687482    2561 flags.go:64] FLAG: --port="10250"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687486    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687492    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d6699c7540728d8d"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687498    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687503    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.687508    2561 flags.go:64] FLAG: --register-node="true"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688225    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688233    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688245    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688250    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688256    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688263    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688268    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688273    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688278    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 18:15:57.695453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688283    2561 flags.go:64] FLAG: --runonce="false"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688293    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688311    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688318    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688323    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688331    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688336    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688341    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688357    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688363    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688373    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688378    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688383    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688389    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688395    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688399    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688409    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688420    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688425    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688432    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688437    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688479    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688494    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688500    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688506    2561 flags.go:64] FLAG: --v="2"
Sep 11 18:15:57.696050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688511    2561 flags.go:64] FLAG: --version="false"
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688517    2561 flags.go:64] FLAG: --vmodule=""
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688522    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.688526    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689062    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689073    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689077    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689081    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689084    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689087    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689089    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689092    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689095    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689098    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689100    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689103    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689106    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689110    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689114    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689117    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:15:57.696680 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689120    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689123    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689127    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689130    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689133    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689142    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689147    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689150    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689153    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689156    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689159    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689162    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689165    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689167    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689170    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689172    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689175    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689178    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689180    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689183    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:15:57.697239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689185    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689188    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689191    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689193    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689196    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689199    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689202    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689205    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689208    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689211    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689213    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689216    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689219    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689224    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689227    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689229    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689232    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689235    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689238    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689240    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:15:57.697762 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689244    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689247    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689249    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689254    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689257    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689261    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689263    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689266    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689269    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689272    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689275    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689277    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689280    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689283    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689285    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689288    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689291    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689293    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689296    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:15:57.698248 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689313    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689318    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689321    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689326    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689329    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689332    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689336    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689339    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689341    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689344    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689347    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689349    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689352    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689355    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689357    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689360    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689363    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689366    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689368    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689371    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:15:57.698738 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689374    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689379    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689381    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.689385    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.689901    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.696977    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.696993    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.697638    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.697646    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697701    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697707    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697710    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697713    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697716    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697719    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:15:57.699252 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697722    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697725    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697729    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697731    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697734    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697737    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697740    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697742    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697745    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697748    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697750    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697754    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697758    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697761    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697764    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697767    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697770    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697773    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697776    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697779    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:15:57.699662 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697782    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697784    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697787    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697791    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697794    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697796    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697799    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697802    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697805    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697807    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697810    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697812    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697815    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697818    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697821    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697824    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697826    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697829    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697831    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697834    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:15:57.700137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697836    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697839    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697842    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697844    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697847    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697850    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697852    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697855    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697857    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697860    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697864    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697868    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697871    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697875    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697879    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697882    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697885    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697888    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697891    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:15:57.700690 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697893    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697896    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697898    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697901    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697904    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697906    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697909    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697911    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697914    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697916    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697919    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697922    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697924    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697927    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697929    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697932    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697934    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697937    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697939    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:15:57.701175 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697942    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697945    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697948    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697950    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697953    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697955    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697959    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697961    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697964    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697968    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697970    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697973    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697976    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697979    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.697981    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:15:57.701751 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.697987    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698100    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698104    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698107    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698110    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698113    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698116    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698119    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698122    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698124    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698127    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698130    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698132    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698135    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698137    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698140    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698144    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698148    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698151    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:15:57.702136 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698153    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698156    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698159    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698162    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698165    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698168    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698172    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698175    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698178    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698181    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698184    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698186    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698189    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698191    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698194    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698196    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698199    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698201    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698204    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698206    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:15:57.702622 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698209    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698211    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698214    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698216    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698219    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698221    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698223    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698226    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698228    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698231    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698233    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698236    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698238    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698242    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698246    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698251    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698257    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698261    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698266    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698269    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:15:57.703138 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698272    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698274    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698277    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698279    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698282    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698285    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698287    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698290    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698293    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698295    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698310    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698314    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698316    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698319    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698321    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698324    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698327    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698330    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698332    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:15:57.703640 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698336    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698340    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698343    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698346    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698349    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698351    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698355    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698357    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698360    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698363    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698365    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698368    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698375    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698378    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698380    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698383    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698386    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698388    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698391    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698394    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:15:57.704114 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698396    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:57.698398    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.698404    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.698504    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.700934    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.701910    2561 server.go:1019] "Starting client certificate rotation"
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.702010    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 18:15:57.704610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.702049    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 18:15:57.705269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.705253    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 18:15:57.708145 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.708131    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 18:15:57.716526 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.716510    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 11 18:15:57.722793 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.722776    2561 log.go:25] "Validated CRI v1 image API"
Sep 11 18:15:57.723690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.723672    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 18:15:57.727138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.727120    2561 fs.go:135] Filesystem UUIDs: map[3d8d43e6-9236-4059-8ff2-57333afbce44:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a0528555-bee1-462e-82c4-3b4c648019d9:/dev/nvme0n1p3]
Sep 11 18:15:57.727186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.727137    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 18:15:57.733237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.733122    2561 manager.go:216] Machine: {Timestamp:2026-09-11 18:15:57.731970433 +0000 UTC m=+0.307073892 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094773 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29ababa204b94cd00a3e9a6c7762f4 SystemUUID:ec29abab-a204-b94c-d00a-3e9a6c7762f4 BootID:5007d43d-1f90-433b-84c6-ca06f44b06dc Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:75:cc:a6:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:75:cc:a6:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:36:97:72:30:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 18:15:57.733237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.733226    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 18:15:57.733386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.733321    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 18:15:57.734941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.734913    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 18:15:57.735115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.734946    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 18:15:57.736088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.736077    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 18:15:57.736129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.736092    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 18:15:57.736129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.736100    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 18:15:57.736733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.736723    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 18:15:57.736942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.736928    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 18:15:57.737556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.737543    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 18:15:57.740368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740357    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 18:15:57.740481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740471    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 18:15:57.740516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740503    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 18:15:57.740516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740513    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 18:15:57.740573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740530    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 18:15:57.740573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740540    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 11 18:15:57.740573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.740550    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 18:15:57.741047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.741033    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 18:15:57.741088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.741064    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 18:15:57.743908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.743890    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 18:15:57.746110 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.746097    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 18:15:57.746164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.746127    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 18:15:57.747590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747574    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 18:15:57.747590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747591    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747597    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747604    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747613    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747619    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747633    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747638    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747644    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747650    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 18:15:57.747679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747664    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 18:15:57.747918 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.747684    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 18:15:57.749034 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.749024    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 18:15:57.749034 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.749034    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 18:15:57.752538 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.752527    2561 server.go:1268] "Started kubelet"
Sep 11 18:15:57.752669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.752631    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 18:15:57.752720 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.752628    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 18:15:57.752720 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.752710    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 18:15:57.753646 ip-10-0-138-165 systemd[1]: Started Kubernetes Kubelet.
Sep 11 18:15:57.754958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.754568    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 18:15:57.754958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.754790    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 18:15:57.756431 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.756409    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 18:15:57.756670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.756655    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 18:15:57.756753 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.756732    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 18:15:57.757445 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.757427    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 18:15:57.759610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.759591    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 18:15:57.760287 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.760269    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 18:15:57.760515 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.760497    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:57.761050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.761030    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 18:15:57.761152 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.761053    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 18:15:57.761249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.761236    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 18:15:57.761342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.761293    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 18:15:57.761342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.761343    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762400    2561 factory.go:153] Registering CRI-O factory
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762419    2561 factory.go:223] Registration of the crio container factory successfully
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762470    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762478    2561 factory.go:55] Registering systemd factory
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762487    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762502    2561 factory.go:103] Registering Raw factory
Sep 11 18:15:57.762885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.762523    2561 manager.go:1196] Started watching for new ooms in manager
Sep 11 18:15:57.763363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.763348    2561 manager.go:349] Starting recovery of all containers
Sep 11 18:15:57.765421 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.762544    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-165.ec2.internal.18d456f3f487a54b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-165.ec2.internal,UID:ip-10-0-138-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-165.ec2.internal,},FirstTimestamp:2026-09-11 18:15:57.752501579 +0000 UTC m=+0.327605038,LastTimestamp:2026-09-11 18:15:57.752501579 +0000 UTC m=+0.327605038,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-165.ec2.internal,}"
Sep 11 18:15:57.769188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.768999    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tk67q"
Sep 11 18:15:57.770669 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.770631    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 18:15:57.770780 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.770756    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 18:15:57.774229 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.774213    2561 manager.go:354] Recovery completed
Sep 11 18:15:57.780477 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.780465    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:57.781356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.781338    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tk67q"
Sep 11 18:15:57.782869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.782853    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:57.782934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.782881    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:57.782934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.782893    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:57.783569 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.783555    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 18:15:57.783569 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.783567    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 18:15:57.783675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.783581    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 18:15:57.783675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.783582    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:57.784382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.784359    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:57.784465 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.784401    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:57.784465 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.784429    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:57.784968 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.784955    2561 policy_none.go:49] "None policy: Start"
Sep 11 18:15:57.785189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.784973    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 18:15:57.785189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.784987    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 18:15:57.785189 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.785039    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-165.ec2.internal.18d456f3f65702f1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-165.ec2.internal,UID:ip-10-0-138-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-165.ec2.internal,},FirstTimestamp:2026-09-11 18:15:57.782868721 +0000 UTC m=+0.357972180,LastTimestamp:2026-09-11 18:15:57.782868721 +0000 UTC m=+0.357972180,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-165.ec2.internal,}"
Sep 11 18:15:57.786996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.786982    2561 policy_none.go:47] "Start"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.814874    2561 manager.go:337] "Starting Device Plugin manager"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.814905    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.814915    2561 server.go:87] "Starting device plugin registration server"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.815241    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.815256    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.815860    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.816013    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.816026    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.816233    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 18:15:57.823582 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.816284    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:57.899392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.899356    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 18:15:57.900590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.900570    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 18:15:57.900700 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.900626    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 18:15:57.900700 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.900655    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 18:15:57.900816 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.900703    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 18:15:57.902990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.902969    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:15:57.916010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.915986    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:57.916892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.916873    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:57.917004 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.916913    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:57.917004 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.916927    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:57.917004 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.916957    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-165.ec2.internal"
Sep 11 18:15:57.925585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:57.925570    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-165.ec2.internal"
Sep 11 18:15:57.925651 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.925596    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-165.ec2.internal\": node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:57.947418 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:57.947345    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.001090 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.001058    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"]
Sep 11 18:15:58.001246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.001132    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:58.002581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.002566    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:58.002684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.002592    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:58.002684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.002602    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:58.003898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.003886    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:58.004330 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.004296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.004437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.004361    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:58.006131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.006108    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:58.006231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.006149    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:58.006231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.006165    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:58.006231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.006168    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:58.006231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.006186    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:58.006231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.006232    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:58.007360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.007345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.007440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.007369    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:15:58.008044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.008029    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:15:58.008103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.008061    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:15:58.008103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.008075    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:15:58.040222 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.040193    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-165.ec2.internal\" not found" node="ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.044708 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.044689    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-165.ec2.internal\" not found" node="ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.047727 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.047712    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.063359 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.063327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7a0c43a5b8f92485d1d4dbb37f3221c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"d7a0c43a5b8f92485d1d4dbb37f3221c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.063492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.063363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0c43a5b8f92485d1d4dbb37f3221c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"d7a0c43a5b8f92485d1d4dbb37f3221c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.063492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.063388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/682cd59bf6288105db0a4c896dcf85f6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-165.ec2.internal\" (UID: \"682cd59bf6288105db0a4c896dcf85f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.148125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.148091    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.163558 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.163531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0c43a5b8f92485d1d4dbb37f3221c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"d7a0c43a5b8f92485d1d4dbb37f3221c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.163658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.163564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/682cd59bf6288105db0a4c896dcf85f6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-165.ec2.internal\" (UID: \"682cd59bf6288105db0a4c896dcf85f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.163658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.163579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7a0c43a5b8f92485d1d4dbb37f3221c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"d7a0c43a5b8f92485d1d4dbb37f3221c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.163658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.163611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0c43a5b8f92485d1d4dbb37f3221c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"d7a0c43a5b8f92485d1d4dbb37f3221c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.163658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.163618    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7a0c43a5b8f92485d1d4dbb37f3221c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"d7a0c43a5b8f92485d1d4dbb37f3221c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.163658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.163634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/682cd59bf6288105db0a4c896dcf85f6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-165.ec2.internal\" (UID: \"682cd59bf6288105db0a4c896dcf85f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.248371 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.248285    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.342709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.342678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.347906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.347855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.348904 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.348884    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.449278 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.449247    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.549600 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.549573    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Sep 11 18:15:58.582283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.582263    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:15:58.607028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.607010    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:15:58.660840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.660820    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.670770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.670751    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 18:15:58.672181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.672169    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Sep 11 18:15:58.683067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.683048    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 18:15:58.702174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.702153    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 18:15:58.702309 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.702281    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 18:15:58.702374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.702332    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 18:15:58.702374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.702335    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 18:15:58.741394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.741364    2561 apiserver.go:52] "Watching apiserver"
Sep 11 18:15:58.756725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.756698    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 18:15:58.757055 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.757036    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vxrl6","openshift-network-diagnostics/network-check-target-w7n49","openshift-network-operator/iptables-alerter-zrhh8","openshift-ovn-kubernetes/ovnkube-node-7qcpn","kube-system/global-pull-secret-syncer-6sbx8","kube-system/konnectivity-agent-mk4dq","kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr","openshift-cluster-node-tuning-operator/tuned-sq8wl","openshift-image-registry/node-ca-4ml5b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal","openshift-multus/multus-additional-cni-plugins-5727l","openshift-dns/node-resolver-c7srq","openshift-multus/multus-s9gv2"]
Sep 11 18:15:58.758754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.758714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.759737 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.759719    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 18:15:58.760007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.759989    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:58.760087 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.760066    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:15:58.760967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.760952    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.761257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.761241    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 18:15:58.761324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.761274    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x45gx\""
Sep 11 18:15:58.761368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.761343    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.761493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.761475    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.763184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.763160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.764987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.764969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.766158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-slash\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-ovn\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-system-cni-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-conf-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d432658-3f35-41e4-ab4a-d24fd02d2b59-host\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.766384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d432658-3f35-41e4-ab4a-d24fd02d2b59-serviceca\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.766384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:58.766384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-cni-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-cnibin\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3edea746-88ee-453b-ad69-ef91ad682a54-cni-binary-copy\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-hostroot\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-systemd\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-var-lib-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-etc-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovnkube-config\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-cni-multus\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-etc-kubernetes\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-run-netns\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.766580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-cni-bin\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovnkube-script-lib\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgt6l\" (UniqueName: \"kubernetes.io/projected/4d432658-3f35-41e4-ab4a-d24fd02d2b59-kube-api-access-kgt6l\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-netns\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-multus-certs\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-systemd-units\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-node-log\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-cni-netd\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovn-node-metrics-cert\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-socket-dir-parent\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3edea746-88ee-453b-ad69-ef91ad682a54-multus-daemon-config\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p695x\" (UniqueName: \"kubernetes.io/projected/3edea746-88ee-453b-ad69-ef91ad682a54-kube-api-access-p695x\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766893    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-kubelet\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-log-socket\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.766995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-env-overrides\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.767017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-k8s-cni-cncf-io\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.767038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-cni-bin\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.767060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-kubelet\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.767537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.767082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fhv6\" (UniqueName: \"kubernetes.io/projected/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-kube-api-access-6fhv6\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.767537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.767110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qkcv\" (UniqueName: \"kubernetes.io/projected/eaafbc73-c564-4e71-81ac-eb55aba7b147-kube-api-access-5qkcv\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:58.768108 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.768092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.768713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.768697    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 18:15:58.769358 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.769316    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 18:15:58.770018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.769565    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.770018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.769665    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9m9gh\""
Sep 11 18:15:58.770018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.769794    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.770018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.769960    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 18:15:58.770208 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.770166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:15:58.770674 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.770646    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:15:58.770967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.770934    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 18:15:58.771382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771118    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.771382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771241    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.771382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771311    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 18:15:58.771592 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771393    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n7lhd\""
Sep 11 18:15:58.771644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771598    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 18:15:58.771885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771867    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zprh5\""
Sep 11 18:15:58.771974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.771909    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 18:15:58.772105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.772084    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.772263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.772247    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 18:15:58.773018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.772323    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 18:15:58.773018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.772571    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.773018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.772613    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.773018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.772753    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qx7q7\""
Sep 11 18:15:58.773283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.773256    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.773615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.773599    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-49gw6\""
Sep 11 18:15:58.773666 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.773656    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.775404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.775381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.776603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.776587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.776692 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.776661    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:15:58.777776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.777761    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkmwq\""
Sep 11 18:15:58.777860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.777846    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zddnf\""
Sep 11 18:15:58.777953 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.777940    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 18:15:58.778053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.778038    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 18:15:58.778193 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.778177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.778557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.778535    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.778671 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.778655    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.778713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.778662    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 18:15:58.780544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.780525    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 18:15:58.780661 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.780557    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 18:15:58.780782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.780758    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:15:58.780848 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.780832    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hqng8\""
Sep 11 18:15:58.784952 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.784911    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 18:10:57 +0000 UTC" deadline="2028-06-15 03:06:53.279685054 +0000 UTC"
Sep 11 18:15:58.784952 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.784953    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15416h50m54.494735224s"
Sep 11 18:15:58.803571 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.803519    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l46f2"
Sep 11 18:15:58.811971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.811956    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l46f2"
Sep 11 18:15:58.826381 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:58.826358    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682cd59bf6288105db0a4c896dcf85f6.slice/crio-ee37820f68704980f0e87f630a4df4226ae75ba0e6217850929fbfeddde2f612 WatchSource:0}: Error finding container ee37820f68704980f0e87f630a4df4226ae75ba0e6217850929fbfeddde2f612: Status 404 returned error can't find the container with id ee37820f68704980f0e87f630a4df4226ae75ba0e6217850929fbfeddde2f612
Sep 11 18:15:58.827180 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:58.827159    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a0c43a5b8f92485d1d4dbb37f3221c.slice/crio-1e748917cdac355ac32d7f2ba42fb1770cb2396a436f4f10ec2e29f378d07666 WatchSource:0}: Error finding container 1e748917cdac355ac32d7f2ba42fb1770cb2396a436f4f10ec2e29f378d07666: Status 404 returned error can't find the container with id 1e748917cdac355ac32d7f2ba42fb1770cb2396a436f4f10ec2e29f378d07666
Sep 11 18:15:58.832629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.832613    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:15:58.862202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.862185    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 18:15:58.867803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-tuned\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.867888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.867888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4586932-39b2-43d4-a6cf-f70b1241d20f-kubelet-config\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.867888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-slash\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.867888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-ovn\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.868054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-ovn\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.868054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-conf-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.868054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-iptables-alerter-script\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.868248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.867955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-slash\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.868387 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-conf-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.868387 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d432658-3f35-41e4-ab4a-d24fd02d2b59-host\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.868475 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d432658-3f35-41e4-ab4a-d24fd02d2b59-serviceca\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.868475 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:58.868569 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d432658-3f35-41e4-ab4a-d24fd02d2b59-host\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.868616 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.868560    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:15:58.868665 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-cni-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.868665 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.868659    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:15:59.368611303 +0000 UTC m=+1.943714762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:15:58.868760 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-cni-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.868816 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.868868 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-socket-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.868868 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.868958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d432658-3f35-41e4-ab4a-d24fd02d2b59-serviceca\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.868958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-etc-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.869054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.868955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-etc-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.869054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovnkube-config\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.869119 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-cni-multus\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-etc-kubernetes\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-device-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476947be-d290-49b9-b5c3-65b974645c5c-tmp-dir\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-systemd\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz8dr\" (UniqueName: \"kubernetes.io/projected/d5a03c55-dc50-44fd-84f5-3871564921b8-kube-api-access-rz8dr\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovnkube-config\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovnkube-script-lib\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-cni-multus\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgt6l\" (UniqueName: \"kubernetes.io/projected/4d432658-3f35-41e4-ab4a-d24fd02d2b59-kube-api-access-kgt6l\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-multus-certs\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bcdb978-2370-4ba7-9b6c-d8d38f6ed080-agent-certs\") pod \"konnectivity-agent-mk4dq\" (UID: \"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080\") " pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-run\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gthfb\" (UniqueName: \"kubernetes.io/projected/81315451-60ba-4a47-8be5-68bfdc4013ba-kube-api-access-gthfb\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-systemd-units\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovn-node-metrics-cert\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.871202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-socket-dir-parent\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3edea746-88ee-453b-ad69-ef91ad682a54-multus-daemon-config\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.869991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p695x\" (UniqueName: \"kubernetes.io/projected/3edea746-88ee-453b-ad69-ef91ad682a54-kube-api-access-p695x\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-lib-modules\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-kubelet\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-env-overrides\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-k8s-cni-cncf-io\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovnkube-script-lib\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-env-overrides\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-etc-kubernetes\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-cni-bin\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bcdb978-2370-4ba7-9b6c-d8d38f6ed080-konnectivity-ca\") pod \"konnectivity-agent-mk4dq\" (UID: \"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080\") " pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-kubernetes\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.872010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.870984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3edea746-88ee-453b-ad69-ef91ad682a54-multus-daemon-config\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fhv6\" (UniqueName: \"kubernetes.io/projected/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-kube-api-access-6fhv6\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qkcv\" (UniqueName: \"kubernetes.io/projected/eaafbc73-c564-4e71-81ac-eb55aba7b147-kube-api-access-5qkcv\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-k8s-cni-cncf-io\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hmfl\" (UniqueName: \"kubernetes.io/projected/25b79a86-efb4-4b8e-a253-af1c76da68b8-kube-api-access-5hmfl\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-multus-socket-dir-parent\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-multus-certs\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-cni-bin\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-kubelet\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4586932-39b2-43d4-a6cf-f70b1241d20f-dbus\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-system-cni-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871327    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-systemd-units\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-host\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-system-cni-dir\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-system-cni-dir\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871546    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.872557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-cnibin\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3edea746-88ee-453b-ad69-ef91ad682a54-cni-binary-copy\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-hostroot\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysctl-conf\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871773    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-cnibin\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-sys\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-hostroot\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871819    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-systemd\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-var-lib-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.871980    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-var-lib-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.872054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b79a86-efb4-4b8e-a253-af1c76da68b8-tmp\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.872064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-systemd\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.872134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-run-netns\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.872903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-run-netns\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.872940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.872981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3edea746-88ee-453b-ad69-ef91ad682a54-cni-binary-copy\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-cni-bin\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-run-openvswitch\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysconfig\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-266zp\" (UniqueName: \"kubernetes.io/projected/476947be-d290-49b9-b5c3-65b974645c5c-kube-api-access-266zp\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-netns\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/476947be-d290-49b9-b5c3-65b974645c5c-hosts-file\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-cni-bin\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-node-log\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-run-netns\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-cni-netd\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-node-log\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbgpk\" (UniqueName: \"kubernetes.io/projected/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-kube-api-access-bbgpk\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-log-socket\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-host-cni-netd\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-kubelet\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-log-socket\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3edea746-88ee-453b-ad69-ef91ad682a54-host-var-lib-kubelet\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.873776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-modprobe-d\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873531    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysctl-d\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-host-slash\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-cnibin\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-registration-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-sys-fs\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.874231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.873616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-var-lib-kubelet\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.875229 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.875214    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-ovn-node-metrics-cert\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.879037 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.879011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgt6l\" (UniqueName: \"kubernetes.io/projected/4d432658-3f35-41e4-ab4a-d24fd02d2b59-kube-api-access-kgt6l\") pod \"node-ca-4ml5b\" (UID: \"4d432658-3f35-41e4-ab4a-d24fd02d2b59\") " pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:58.879322 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.879285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fhv6\" (UniqueName: \"kubernetes.io/projected/c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f-kube-api-access-6fhv6\") pod \"ovnkube-node-7qcpn\" (UID: \"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:58.879643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.879619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p695x\" (UniqueName: \"kubernetes.io/projected/3edea746-88ee-453b-ad69-ef91ad682a54-kube-api-access-p695x\") pod \"multus-s9gv2\" (UID: \"3edea746-88ee-453b-ad69-ef91ad682a54\") " pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:58.879761 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.879741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qkcv\" (UniqueName: \"kubernetes.io/projected/eaafbc73-c564-4e71-81ac-eb55aba7b147-kube-api-access-5qkcv\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:58.904420 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.904381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" event={"ID":"d7a0c43a5b8f92485d1d4dbb37f3221c","Type":"ContainerStarted","Data":"1e748917cdac355ac32d7f2ba42fb1770cb2396a436f4f10ec2e29f378d07666"}
Sep 11 18:15:58.905407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.905390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal" event={"ID":"682cd59bf6288105db0a4c896dcf85f6","Type":"ContainerStarted","Data":"ee37820f68704980f0e87f630a4df4226ae75ba0e6217850929fbfeddde2f612"}
Sep 11 18:15:58.974638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysconfig\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-266zp\" (UniqueName: \"kubernetes.io/projected/476947be-d290-49b9-b5c3-65b974645c5c-kube-api-access-266zp\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/476947be-d290-49b9-b5c3-65b974645c5c-hosts-file\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbgpk\" (UniqueName: \"kubernetes.io/projected/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-kube-api-access-bbgpk\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-modprobe-d\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysctl-d\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysconfig\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-host-slash\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.974781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974768    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/476947be-d290-49b9-b5c3-65b974645c5c-hosts-file\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-cnibin\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-host-slash\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-registration-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-cnibin\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-modprobe-d\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysctl-d\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-registration-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-sys-fs\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974909    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-sys-fs\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-var-lib-kubelet\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-tuned\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-var-lib-kubelet\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.974984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4586932-39b2-43d4-a6cf-f70b1241d20f-kubelet-config\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-iptables-alerter-script\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.975158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4586932-39b2-43d4-a6cf-f70b1241d20f-kubelet-config\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-socket-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-device-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476947be-d290-49b9-b5c3-65b974645c5c-tmp-dir\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-socket-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-systemd\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz8dr\" (UniqueName: \"kubernetes.io/projected/d5a03c55-dc50-44fd-84f5-3871564921b8-kube-api-access-rz8dr\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/81315451-60ba-4a47-8be5-68bfdc4013ba-device-dir\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bcdb978-2370-4ba7-9b6c-d8d38f6ed080-agent-certs\") pod \"konnectivity-agent-mk4dq\" (UID: \"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080\") " pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-run\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975422    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-run\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-systemd\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.975345    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:15:58.975982 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.975504    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:15:59.475485987 +0000 UTC m=+2.050589442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476947be-d290-49b9-b5c3-65b974645c5c-tmp-dir\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-iptables-alerter-script\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gthfb\" (UniqueName: \"kubernetes.io/projected/81315451-60ba-4a47-8be5-68bfdc4013ba-kube-api-access-gthfb\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-lib-modules\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bcdb978-2370-4ba7-9b6c-d8d38f6ed080-konnectivity-ca\") pod \"konnectivity-agent-mk4dq\" (UID: \"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080\") " pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-kubernetes\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hmfl\" (UniqueName: \"kubernetes.io/projected/25b79a86-efb4-4b8e-a253-af1c76da68b8-kube-api-access-5hmfl\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4586932-39b2-43d4-a6cf-f70b1241d20f-dbus\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-kubernetes\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-host\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-system-cni-dir\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-lib-modules\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4586932-39b2-43d4-a6cf-f70b1241d20f-dbus\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:58.976839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysctl-conf\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-sys\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-system-cni-dir\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.975997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b79a86-efb4-4b8e-a253-af1c76da68b8-tmp\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-host\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-sys\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-sysctl-conf\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a03c55-dc50-44fd-84f5-3871564921b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bcdb978-2370-4ba7-9b6c-d8d38f6ed080-konnectivity-ca\") pod \"konnectivity-agent-mk4dq\" (UID: \"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080\") " pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.976501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5a03c55-dc50-44fd-84f5-3871564921b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:58.977637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.977523    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25b79a86-efb4-4b8e-a253-af1c76da68b8-etc-tuned\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.977989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.977923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bcdb978-2370-4ba7-9b6c-d8d38f6ed080-agent-certs\") pod \"konnectivity-agent-mk4dq\" (UID: \"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080\") " pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:58.978019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.978003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b79a86-efb4-4b8e-a253-af1c76da68b8-tmp\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.988989 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.988966    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:15:58.988989 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.988986    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:15:58.989117 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.988998    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:15:58.989117 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:58.989052    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:15:59.489039741 +0000 UTC m=+2.064143187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:15:58.990624 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.990591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbgpk\" (UniqueName: \"kubernetes.io/projected/a4addd88-c0b9-4d79-858c-ac5d7ec40e2b-kube-api-access-bbgpk\") pod \"iptables-alerter-zrhh8\" (UID: \"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b\") " pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:58.990830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.990809    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-266zp\" (UniqueName: \"kubernetes.io/projected/476947be-d290-49b9-b5c3-65b974645c5c-kube-api-access-266zp\") pod \"node-resolver-c7srq\" (UID: \"476947be-d290-49b9-b5c3-65b974645c5c\") " pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:58.992049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.992029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gthfb\" (UniqueName: \"kubernetes.io/projected/81315451-60ba-4a47-8be5-68bfdc4013ba-kube-api-access-gthfb\") pod \"aws-ebs-csi-driver-node-drpmr\" (UID: \"81315451-60ba-4a47-8be5-68bfdc4013ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:58.992580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.992563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hmfl\" (UniqueName: \"kubernetes.io/projected/25b79a86-efb4-4b8e-a253-af1c76da68b8-kube-api-access-5hmfl\") pod \"tuned-sq8wl\" (UID: \"25b79a86-efb4-4b8e-a253-af1c76da68b8\") " pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:58.992633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:58.992583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz8dr\" (UniqueName: \"kubernetes.io/projected/d5a03c55-dc50-44fd-84f5-3871564921b8-kube-api-access-rz8dr\") pod \"multus-additional-cni-plugins-5727l\" (UID: \"d5a03c55-dc50-44fd-84f5-3871564921b8\") " pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:59.079850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.079785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ml5b"
Sep 11 18:15:59.088021 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.087998    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d432658_3f35_41e4_ab4a_d24fd02d2b59.slice/crio-1b25191d716bd1a4f56999263382fa70483186bd8a0ca2185a274b3080afc951 WatchSource:0}: Error finding container 1b25191d716bd1a4f56999263382fa70483186bd8a0ca2185a274b3080afc951: Status 404 returned error can't find the container with id 1b25191d716bd1a4f56999263382fa70483186bd8a0ca2185a274b3080afc951
Sep 11 18:15:59.093027 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.093012    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s9gv2"
Sep 11 18:15:59.099293 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.099262    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edea746_88ee_453b_ad69_ef91ad682a54.slice/crio-acda6f8b006f7e8e92a8660b8243ba61a1cbbf5155afca6284584aaf741fc740 WatchSource:0}: Error finding container acda6f8b006f7e8e92a8660b8243ba61a1cbbf5155afca6284584aaf741fc740: Status 404 returned error can't find the container with id acda6f8b006f7e8e92a8660b8243ba61a1cbbf5155afca6284584aaf741fc740
Sep 11 18:15:59.109021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.109004    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:15:59.115280 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.115253    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57d88bc_6ee4_4f14_a5c3_801c7b8daf0f.slice/crio-498f89d9ffa6c597e7a24904aabbcef32c3312197d8ec8145a1fb9d0ef1df371 WatchSource:0}: Error finding container 498f89d9ffa6c597e7a24904aabbcef32c3312197d8ec8145a1fb9d0ef1df371: Status 404 returned error can't find the container with id 498f89d9ffa6c597e7a24904aabbcef32c3312197d8ec8145a1fb9d0ef1df371
Sep 11 18:15:59.127504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.127486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr"
Sep 11 18:15:59.133975 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.133955    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:15:59.134257 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.134236    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81315451_60ba_4a47_8be5_68bfdc4013ba.slice/crio-98bf12b39bad70897ac3638284f16156bf4a1379640acd2cf7083851ee6c180a WatchSource:0}: Error finding container 98bf12b39bad70897ac3638284f16156bf4a1379640acd2cf7083851ee6c180a: Status 404 returned error can't find the container with id 98bf12b39bad70897ac3638284f16156bf4a1379640acd2cf7083851ee6c180a
Sep 11 18:15:59.139483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.139456    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c7srq"
Sep 11 18:15:59.144725 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.144689    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcdb978_2370_4ba7_9b6c_d8d38f6ed080.slice/crio-48e297718f919953e38e92cc7abbd640f01a56c7befb5eea4eba53e2e6d293c8 WatchSource:0}: Error finding container 48e297718f919953e38e92cc7abbd640f01a56c7befb5eea4eba53e2e6d293c8: Status 404 returned error can't find the container with id 48e297718f919953e38e92cc7abbd640f01a56c7befb5eea4eba53e2e6d293c8
Sep 11 18:15:59.144725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.144718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sq8wl"
Sep 11 18:15:59.147149 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.147117    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476947be_d290_49b9_b5c3_65b974645c5c.slice/crio-7bdcddd0332f34e1fec2a053a4159d8fb134734275f48240ce25c9777da7f608 WatchSource:0}: Error finding container 7bdcddd0332f34e1fec2a053a4159d8fb134734275f48240ce25c9777da7f608: Status 404 returned error can't find the container with id 7bdcddd0332f34e1fec2a053a4159d8fb134734275f48240ce25c9777da7f608
Sep 11 18:15:59.150448 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.150431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5727l"
Sep 11 18:15:59.153528 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.153507    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b79a86_efb4_4b8e_a253_af1c76da68b8.slice/crio-4720327f097a3849fa0fd06fb393c05392e08d0cd6490298520b6a30703ed2a2 WatchSource:0}: Error finding container 4720327f097a3849fa0fd06fb393c05392e08d0cd6490298520b6a30703ed2a2: Status 404 returned error can't find the container with id 4720327f097a3849fa0fd06fb393c05392e08d0cd6490298520b6a30703ed2a2
Sep 11 18:15:59.156334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.156318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zrhh8"
Sep 11 18:15:59.158036 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.158012    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a03c55_dc50_44fd_84f5_3871564921b8.slice/crio-a73cff1619cfba1dc935e361bb6371063b8960f9baecdc87a67c716f132ded9b WatchSource:0}: Error finding container a73cff1619cfba1dc935e361bb6371063b8960f9baecdc87a67c716f132ded9b: Status 404 returned error can't find the container with id a73cff1619cfba1dc935e361bb6371063b8960f9baecdc87a67c716f132ded9b
Sep 11 18:15:59.163841 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:15:59.163821    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4addd88_c0b9_4d79_858c_ac5d7ec40e2b.slice/crio-f68f9adba9ee1c8541a1c7702af7179549be2215cecf7e8f96245e446c032518 WatchSource:0}: Error finding container f68f9adba9ee1c8541a1c7702af7179549be2215cecf7e8f96245e446c032518: Status 404 returned error can't find the container with id f68f9adba9ee1c8541a1c7702af7179549be2215cecf7e8f96245e446c032518
Sep 11 18:15:59.334073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.333991    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:15:59.379695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.379510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:15:59.379695 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.379694    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:15:59.379940 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.379772    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:00.379749777 +0000 UTC m=+2.954853235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:15:59.480182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.480151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:59.480369 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.480312    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:15:59.480441 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.480377    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:16:00.480363741 +0000 UTC m=+3.055467187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:15:59.580567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.580530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:15:59.580733 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.580707    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:15:59.580733 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.580726    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:15:59.580845 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.580739    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:15:59.580845 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.580798    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:00.58077893 +0000 UTC m=+3.155882381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:15:59.815235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.815118    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:10:58 +0000 UTC" deadline="2028-03-16 01:17:54.931978068 +0000 UTC"
Sep 11 18:15:59.815235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.815180    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13231h1m55.11680257s"
Sep 11 18:15:59.844098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.844069    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:15:59.904767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.901943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:15:59.904767 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:15:59.902075    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:15:59.927644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.927602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ml5b" event={"ID":"4d432658-3f35-41e4-ab4a-d24fd02d2b59","Type":"ContainerStarted","Data":"1b25191d716bd1a4f56999263382fa70483186bd8a0ca2185a274b3080afc951"}
Sep 11 18:15:59.944537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.944434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerStarted","Data":"a73cff1619cfba1dc935e361bb6371063b8960f9baecdc87a67c716f132ded9b"}
Sep 11 18:15:59.948707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.948625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sq8wl" event={"ID":"25b79a86-efb4-4b8e-a253-af1c76da68b8","Type":"ContainerStarted","Data":"4720327f097a3849fa0fd06fb393c05392e08d0cd6490298520b6a30703ed2a2"}
Sep 11 18:15:59.952728 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.951965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mk4dq" event={"ID":"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080","Type":"ContainerStarted","Data":"48e297718f919953e38e92cc7abbd640f01a56c7befb5eea4eba53e2e6d293c8"}
Sep 11 18:15:59.964512 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.964482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr" event={"ID":"81315451-60ba-4a47-8be5-68bfdc4013ba","Type":"ContainerStarted","Data":"98bf12b39bad70897ac3638284f16156bf4a1379640acd2cf7083851ee6c180a"}
Sep 11 18:15:59.975159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.975111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zrhh8" event={"ID":"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b","Type":"ContainerStarted","Data":"f68f9adba9ee1c8541a1c7702af7179549be2215cecf7e8f96245e446c032518"}
Sep 11 18:15:59.985239 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.985202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c7srq" event={"ID":"476947be-d290-49b9-b5c3-65b974645c5c","Type":"ContainerStarted","Data":"7bdcddd0332f34e1fec2a053a4159d8fb134734275f48240ce25c9777da7f608"}
Sep 11 18:15:59.989063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:15:59.989038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"498f89d9ffa6c597e7a24904aabbcef32c3312197d8ec8145a1fb9d0ef1df371"}
Sep 11 18:16:00.001632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.001604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s9gv2" event={"ID":"3edea746-88ee-453b-ad69-ef91ad682a54","Type":"ContainerStarted","Data":"acda6f8b006f7e8e92a8660b8243ba61a1cbbf5155afca6284584aaf741fc740"}
Sep 11 18:16:00.385609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.385566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:00.385808 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.385788    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:00.385895 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.385856    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:02.385837808 +0000 UTC m=+4.960941256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:00.487176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.486542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:00.487176 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.486757    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:00.487176 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.486825    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:16:02.486805012 +0000 UTC m=+5.061908458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:00.587953 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.587811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:00.588125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.588006    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:16:00.588125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.588035    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:16:00.588125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.588049    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:00.588125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.588111    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:02.5880919 +0000 UTC m=+5.163195350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:00.816319 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.816261    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:10:58 +0000 UTC" deadline="2028-02-12 11:32:15.401110488 +0000 UTC"
Sep 11 18:16:00.816319 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.816316    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12449h16m14.584799122s"
Sep 11 18:16:00.901951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.901249    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:00.901951 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.901391    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:00.901951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:00.901793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:00.901951 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:00.901899    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:01.324396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:01.324161    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:16:01.864074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:01.863844    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:16:01.919366 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:01.919336    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:01.919540 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:01.919468    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:02.402115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:02.402073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:02.402330 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.402292    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:02.402405 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.402377    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:06.40235789 +0000 UTC m=+8.977461355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:02.502787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:02.502744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:02.502984 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.502946    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:02.503059 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.503017    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:16:06.502996908 +0000 UTC m=+9.078100378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:02.604772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:02.604141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:02.604772 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.604316    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:16:02.604772 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.604338    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:16:02.604772 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.604351    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:02.604772 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.604414    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:06.604394851 +0000 UTC m=+9.179498303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:02.901449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:02.901410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:02.901876 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.901565    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:02.901943 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:02.901922    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:02.902058 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:02.902034    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:03.903619 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:03.903578    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:03.904068 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:03.903716    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:04.901769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:04.901735    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:04.901932 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:04.901863    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:04.902137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:04.902109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:04.902273 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:04.902244    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:05.901775 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:05.901739    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:05.902391 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:05.901879    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:06.436640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:06.436556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:06.436870 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.436720    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:06.436870 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.436806    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:14.436782614 +0000 UTC m=+17.011886074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:06.537961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:06.537911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:06.538134 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.538102    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:06.538212 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.538181    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:16:14.53815921 +0000 UTC m=+17.113262673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:06.639667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:06.638924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:06.639667 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.639189    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:16:06.639667 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.639211    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:16:06.639667 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.639253    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:06.639667 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.639323    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:14.639291884 +0000 UTC m=+17.214395333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:06.901701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:06.901612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:06.901891 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.901748    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:06.901891 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:06.901799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:06.902260 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:06.901918    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:07.902462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:07.902424    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:07.902906 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:07.902553    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:08.901131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:08.901094    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:08.901131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:08.901114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:08.901372 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:08.901205    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:08.901372 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:08.901337    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:09.903727 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:09.903695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:09.904182 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:09.903812    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:10.901709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:10.901668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:10.901709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:10.901695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:10.901967 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:10.901802    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:10.901967 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:10.901945    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:11.903989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:11.903954    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:11.904511 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:11.904059    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:12.901583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:12.901540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:12.901583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:12.901576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:12.901841 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:12.901669    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:12.901841 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:12.901810    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:13.901694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:13.901619    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:13.902078 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:13.901753    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:14.501501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:14.501458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:14.501718 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.501589    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:14.501718 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.501666    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:30.501644399 +0000 UTC m=+33.076747866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:14.602892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:14.602848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:14.603079 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.603013    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:14.603138 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.603093    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:16:30.603073128 +0000 UTC m=+33.178176588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:14.703586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:14.703550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:14.703760 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.703691    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:16:14.703760 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.703715    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:16:14.703760 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.703729    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:14.703895 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.703837    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:30.703778339 +0000 UTC m=+33.278881790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:14.900949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:14.900864    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:14.901107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:14.900868    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:14.901107 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.900995    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:14.901107 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:14.901068    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:15.900918 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:15.900886    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:15.901388 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:15.901010    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:16.901805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:16.901764    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:16.902280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:16.901817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:16.902280 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:16.901896    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:16.902280 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:16.902039    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:17.902063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:17.901804    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:17.902728 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:17.902116    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:18.059741 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.059491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sq8wl" event={"ID":"25b79a86-efb4-4b8e-a253-af1c76da68b8","Type":"ContainerStarted","Data":"2a2659db3f3acc95c4c3bcbe9b9c2f2362536c5146a0b1d85687f810cdb908e6"}
Sep 11 18:16:18.061464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.061439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal" event={"ID":"682cd59bf6288105db0a4c896dcf85f6","Type":"ContainerStarted","Data":"e0ee87a6c0fc7b05d3b7d137ba32094d8a944e440b44f70a47b4175ea20ea300"}
Sep 11 18:16:18.064518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.064496    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:16:18.065020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.064990    2561 generic.go:356] "Generic (PLEG): container finished" podID="c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f" containerID="aa530875e0c368fd9a12acd698c771ebfc32ea838481c6f6eef03fc77ce6f038" exitCode=1
Sep 11 18:16:18.065074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.065045    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"7d8657db42c53cf7bb3423b11b563faa51f436e213f91103b00e823efc0cff92"}
Sep 11 18:16:18.065155 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.065141    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"393d8cd51e4366ee57da4425473dc8b1c81c8cd92db9200747b234851cfb41f6"}
Sep 11 18:16:18.065222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.065208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"045b2f0c841f7234ffa027a3b03f84440cc377713568f9251682ffee95b22051"}
Sep 11 18:16:18.065286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.065274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerDied","Data":"aa530875e0c368fd9a12acd698c771ebfc32ea838481c6f6eef03fc77ce6f038"}
Sep 11 18:16:18.065461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.065444    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"2072bc2397ee5245aad3e0fa3636067174c377b41418d790c325066ab10f8ad5"}
Sep 11 18:16:18.066677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.066654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s9gv2" event={"ID":"3edea746-88ee-453b-ad69-ef91ad682a54","Type":"ContainerStarted","Data":"684c000b3fbb497a0a4ea2c01621263e59c16f880b1f3226fbb9d5e5fd954a42"}
Sep 11 18:16:18.105012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.104962    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sq8wl" podStartSLOduration=1.938615033 podStartE2EDuration="20.104946346s" totalImagesPullingTime="18.166331313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:18.081885326 +0000 UTC m=+20.656988795" watchObservedRunningTime="2026-09-11 18:16:18.104946346 +0000 UTC m=+20.680049814"
Sep 11 18:16:18.105225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.105205    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s9gv2" podStartSLOduration=2.4021667349999998 podStartE2EDuration="21.105200553s" totalImagesPullingTime="18.703033818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:18.104590581 +0000 UTC m=+20.679694049" watchObservedRunningTime="2026-09-11 18:16:18.105200553 +0000 UTC m=+20.680304038"
Sep 11 18:16:18.901877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.901842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:18.902010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:18.901857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:18.902010 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:18.901976    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:18.902081 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:18.902007    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:19.069758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.069724    2561 generic.go:356] "Generic (PLEG): container finished" podID="d7a0c43a5b8f92485d1d4dbb37f3221c" containerID="1e06fafb8defa8b24083e92c19fcb8efbace2d66f80698e7736843b09881bd73" exitCode=0
Sep 11 18:16:19.069919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.069812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" event={"ID":"d7a0c43a5b8f92485d1d4dbb37f3221c","Type":"ContainerDied","Data":"1e06fafb8defa8b24083e92c19fcb8efbace2d66f80698e7736843b09881bd73"}
Sep 11 18:16:19.071326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.071291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zrhh8" event={"ID":"a4addd88-c0b9-4d79-858c-ac5d7ec40e2b","Type":"ContainerStarted","Data":"bd17478f1556929e39201762a5932e77af9ced5b4cd8015a59972aac37a7e8f4"}
Sep 11 18:16:19.072529 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.072509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c7srq" event={"ID":"476947be-d290-49b9-b5c3-65b974645c5c","Type":"ContainerStarted","Data":"cd079f839ce0c15fe0c1c63855bf0aee4a13b7e63cd309f6f7690f82bc55efab"}
Sep 11 18:16:19.075137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.075123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:16:19.075513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.075495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"a322cf4d722945b18371c7383fa8996163b56b604780578a98bb9b7defdad2e5"}
Sep 11 18:16:19.076711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.076694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ml5b" event={"ID":"4d432658-3f35-41e4-ab4a-d24fd02d2b59","Type":"ContainerStarted","Data":"2798bdf4a79c019a76553cee6ee740c8328762c1ef3877049bae5efb4ec2f96c"}
Sep 11 18:16:19.078087 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.078066    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5a03c55-dc50-44fd-84f5-3871564921b8" containerID="bd53b3646c7dd73a1676bf230325a5807d1b6369ac799a422034361e0186aa13" exitCode=0
Sep 11 18:16:19.078163 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.078086    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerDied","Data":"bd53b3646c7dd73a1676bf230325a5807d1b6369ac799a422034361e0186aa13"}
Sep 11 18:16:19.079550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.079533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mk4dq" event={"ID":"4bcdb978-2370-4ba7-9b6c-d8d38f6ed080","Type":"ContainerStarted","Data":"8dd7983f7dc697b4cee01db46314be169eecf9022a03474b95b97f9ce8eca175"}
Sep 11 18:16:19.080907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.080886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr" event={"ID":"81315451-60ba-4a47-8be5-68bfdc4013ba","Type":"ContainerStarted","Data":"8a480e7d778e06720dd9bae0606e765aba8c9f605e80bb5e32046cc5af2181f3"}
Sep 11 18:16:19.090212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.090177    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal" podStartSLOduration=21.090165512 podStartE2EDuration="21.090165512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:18.124412116 +0000 UTC m=+20.699515584" watchObservedRunningTime="2026-09-11 18:16:19.090165512 +0000 UTC m=+21.665268980"
Sep 11 18:16:19.104134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.104098    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4ml5b" podStartSLOduration=3.873675265 podStartE2EDuration="22.104090073s" totalImagesPullingTime="18.230414808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:19.104014137 +0000 UTC m=+21.679117605" watchObservedRunningTime="2026-09-11 18:16:19.104090073 +0000 UTC m=+21.679193540"
Sep 11 18:16:19.123679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.123644    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mk4dq" podStartSLOduration=3.950615179 podStartE2EDuration="22.123631948s" totalImagesPullingTime="18.173016769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:19.123418643 +0000 UTC m=+21.698522124" watchObservedRunningTime="2026-09-11 18:16:19.123631948 +0000 UTC m=+21.698735446"
Sep 11 18:16:19.142030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.141985    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c7srq" podStartSLOduration=2.973241966 podStartE2EDuration="21.141968746s" totalImagesPullingTime="18.16872678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:19.14138203 +0000 UTC m=+21.716485500" watchObservedRunningTime="2026-09-11 18:16:19.141968746 +0000 UTC m=+21.717072214"
Sep 11 18:16:19.182677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.182610    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zrhh8" podStartSLOduration=7.075595583 podStartE2EDuration="21.182592672s" totalImagesPullingTime="14.106997089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:19.182313365 +0000 UTC m=+21.757416826" watchObservedRunningTime="2026-09-11 18:16:19.182592672 +0000 UTC m=+21.757696164"
Sep 11 18:16:19.206845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.206633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:19.247945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.247898    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 18:16:19.309317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.309280    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:19.375517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.375409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:19.767405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.767374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:19.828393 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.828202    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T18:16:19.247918121Z","UUID":"392824b1-1d22-4a9b-888a-910a7d5bef88","Handler":null,"Name":"","Endpoint":""}
Sep 11 18:16:19.829907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.829876    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:19.830409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.830384    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 18:16:19.830523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.830425    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 18:16:19.901168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:19.901100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:19.901381 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:19.901279    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:20.086364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.086252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr" event={"ID":"81315451-60ba-4a47-8be5-68bfdc4013ba","Type":"ContainerStarted","Data":"4a26d9a2d0ffe952f7628fb0a44a6a34702985cdb23d181aa2fa6363cebbe889"}
Sep 11 18:16:20.089095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.089056    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" event={"ID":"d7a0c43a5b8f92485d1d4dbb37f3221c","Type":"ContainerStarted","Data":"c70b083c11a449b3f73ae9a79eb1455d4d382b5f554c6bf44c975708dd7b2d46"}
Sep 11 18:16:20.107094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.107037    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" podStartSLOduration=22.107016295 podStartE2EDuration="22.107016295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:20.106762794 +0000 UTC m=+22.681866264" watchObservedRunningTime="2026-09-11 18:16:20.107016295 +0000 UTC m=+22.682119764"
Sep 11 18:16:20.616649 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.616560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:20.698423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.698383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:20.901541 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.901464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:20.901712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:20.901464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:20.901712 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:20.901576    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:20.901712 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:20.901660    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:21.095748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.095720    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:16:21.096254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.096178    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"da472c03cf273461de1ce6e42c9bef86b41911705a034167ded12b53533909cc"}
Sep 11 18:16:21.098722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.098688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr" event={"ID":"81315451-60ba-4a47-8be5-68bfdc4013ba","Type":"ContainerStarted","Data":"97329a839610981b84758026048456b0a2c90523b0ce5bd5efb490d2cb454698"}
Sep 11 18:16:21.126622 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.126567    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drpmr" podStartSLOduration=3.922084708 podStartE2EDuration="24.126551961s" totalImagesPullingTime="20.204467253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:21.126347185 +0000 UTC m=+23.701450655" watchObservedRunningTime="2026-09-11 18:16:21.126551961 +0000 UTC m=+23.701655479"
Sep 11 18:16:21.130398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.130372    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:16:21.131035 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.131012    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:16:21.901153 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:21.901122    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:21.901447 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:21.901234    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:22.100988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:22.100954    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:16:22.101596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:22.101323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mk4dq"
Sep 11 18:16:22.178670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:22.178561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:22.901553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:22.901521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:22.901728 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:22.901522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:22.901728 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:22.901651    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:22.901825 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:22.901724    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:23.119695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:23.119665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:23.217143 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:23.216997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:23.901462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:23.901425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:23.901636 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:23.901565    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:24.115036 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.115010    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:16:24.115462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.115424    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"5616254464ee1820e2737922ead6f60d82b467e656c6efa9aa3f45ba8546677b"}
Sep 11 18:16:24.115599 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.115577    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:16:24.115670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.115658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:16:24.115742 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.115709    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:16:24.115907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.115891    2561 scope.go:117] "RemoveContainer" containerID="aa530875e0c368fd9a12acd698c771ebfc32ea838481c6f6eef03fc77ce6f038"
Sep 11 18:16:24.117552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.117525    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5a03c55-dc50-44fd-84f5-3871564921b8" containerID="d64b0e7da819c08660d5e894aa98a7784ad9193286a171b6eaf498205548265e" exitCode=0
Sep 11 18:16:24.117671 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.117603    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerDied","Data":"d64b0e7da819c08660d5e894aa98a7784ad9193286a171b6eaf498205548265e"}
Sep 11 18:16:24.132016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.131949    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:16:24.133348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.133328    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:16:24.901951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.901910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:24.902107 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:24.902062    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:24.902259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:24.902204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:24.902356 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:24.902338    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:25.086442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.086227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w7n49"]
Sep 11 18:16:25.092668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.092522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6sbx8"]
Sep 11 18:16:25.092668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.092641    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:25.092863 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:25.092738    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:25.093217 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.093196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vxrl6"]
Sep 11 18:16:25.124178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.124147    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:16:25.124668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.124628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" event={"ID":"c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f","Type":"ContainerStarted","Data":"06e83c8cede16ab999691e98567daa8d80162038a23b66f502f7ff846d626880"}
Sep 11 18:16:25.130516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.130491    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5a03c55-dc50-44fd-84f5-3871564921b8" containerID="73a78e3b0ced694d2d7dfbb0f648478de1080eaa9a84d702a7c597869b434430" exitCode=0
Sep 11 18:16:25.130626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.130570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerDied","Data":"73a78e3b0ced694d2d7dfbb0f648478de1080eaa9a84d702a7c597869b434430"}
Sep 11 18:16:25.130626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.130607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:25.130722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.130650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:25.130764 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:25.130743    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:25.130868 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:25.130843    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:25.160202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:25.160138    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn" podStartSLOduration=9.921274591 podStartE2EDuration="28.16011872s" totalImagesPullingTime="18.238844129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:25.158317094 +0000 UTC m=+27.733420554" watchObservedRunningTime="2026-09-11 18:16:25.16011872 +0000 UTC m=+27.735222190"
Sep 11 18:16:26.135131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:26.135097    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5a03c55-dc50-44fd-84f5-3871564921b8" containerID="16cb7334257943c5c62e0f3abc2f0afca90ccc77bd4f0ac97424b546b81030cc" exitCode=0
Sep 11 18:16:26.135341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:26.135169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerDied","Data":"16cb7334257943c5c62e0f3abc2f0afca90ccc77bd4f0ac97424b546b81030cc"}
Sep 11 18:16:26.901190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:26.901158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:26.901659 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:26.901204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:26.901659 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:26.901277    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:26.901659 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:26.901314    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:26.901659 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:26.901391    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:26.901659 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:26.901459    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:28.901321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:28.901192    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:28.901321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:28.901223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:28.901321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:28.901223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:28.901961 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:28.901371    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sbx8" podUID="f4586932-39b2-43d4-a6cf-f70b1241d20f"
Sep 11 18:16:28.901961 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:28.901507    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w7n49" podUID="f0eeefc0-31c9-461c-8de3-986e4529e7d1"
Sep 11 18:16:28.901961 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:28.901612    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:16:29.916960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:29.916921    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:30.010098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.010063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:30.524049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.524019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:30.524170 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.524149    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:30.524226 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.524217    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:17:02.52420019 +0000 UTC m=+65.099303636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:16:30.624424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.624394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:30.624553 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.624535    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:30.624612 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.624602    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret podName:f4586932-39b2-43d4-a6cf-f70b1241d20f nodeName:}" failed. No retries permitted until 2026-09-11 18:17:02.624585118 +0000 UTC m=+65.199688582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret") pod "global-pull-secret-syncer-6sbx8" (UID: "f4586932-39b2-43d4-a6cf-f70b1241d20f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:16:30.725776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.725723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:30.725967 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.725882    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:16:30.725967 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.725903    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:16:30.725967 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.725915    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5jqgw for pod openshift-network-diagnostics/network-check-target-w7n49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:30.726123 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:30.725979    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw podName:f0eeefc0-31c9-461c-8de3-986e4529e7d1 nodeName:}" failed. No retries permitted until 2026-09-11 18:17:02.725959514 +0000 UTC m=+65.301062972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jqgw" (UniqueName: "kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw") pod "network-check-target-w7n49" (UID: "f0eeefc0-31c9-461c-8de3-986e4529e7d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:16:30.739638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.739615    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeReady"
Sep 11 18:16:30.739791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.739778    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 18:16:30.788180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.788144    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mxg7k"]
Sep 11 18:16:30.814251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.814224    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sghhm"]
Sep 11 18:16:30.814420 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.814371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:30.816858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.816827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 18:16:30.817122 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.816837    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bf6d6\""
Sep 11 18:16:30.817122 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.816932    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 18:16:30.838244 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.838217    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxg7k"]
Sep 11 18:16:30.838378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.838253    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sghhm"]
Sep 11 18:16:30.838378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.838343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:30.842314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.842289    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 18:16:30.842398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.842380    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gb2xv\""
Sep 11 18:16:30.842653 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.842638    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 18:16:30.842782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.842768    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 18:16:30.901394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.901288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:16:30.901394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.901338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:16:30.901394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.901392    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:16:30.903959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.903937    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 18:16:30.904147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.904133    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bn27r\""
Sep 11 18:16:30.904232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.904176    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 18:16:30.904232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.904194    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 18:16:30.904232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.904206    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-76gd9\""
Sep 11 18:16:30.904409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.904295    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 18:16:30.927075 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.927055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52319ff3-1bb1-4d09-aa44-67ba79a834b3-cert\") pod \"ingress-canary-sghhm\" (UID: \"52319ff3-1bb1-4d09-aa44-67ba79a834b3\") " pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:30.927363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.927081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldnzb\" (UniqueName: \"kubernetes.io/projected/52319ff3-1bb1-4d09-aa44-67ba79a834b3-kube-api-access-ldnzb\") pod \"ingress-canary-sghhm\" (UID: \"52319ff3-1bb1-4d09-aa44-67ba79a834b3\") " pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:30.927363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.927144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-config-volume\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:30.927363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.927180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxtz\" (UniqueName: \"kubernetes.io/projected/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-kube-api-access-dlxtz\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:30.927363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.927225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-tmp-dir\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:30.927363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.927243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:30.951130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:30.951108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:31.017450 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.017426    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:31.028380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.028354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-config-volume\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.028478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.028425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxtz\" (UniqueName: \"kubernetes.io/projected/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-kube-api-access-dlxtz\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.028535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.028475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-tmp-dir\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.028535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.028501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.028656 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.028538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52319ff3-1bb1-4d09-aa44-67ba79a834b3-cert\") pod \"ingress-canary-sghhm\" (UID: \"52319ff3-1bb1-4d09-aa44-67ba79a834b3\") " pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:31.028656 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.028562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldnzb\" (UniqueName: \"kubernetes.io/projected/52319ff3-1bb1-4d09-aa44-67ba79a834b3-kube-api-access-ldnzb\") pod \"ingress-canary-sghhm\" (UID: \"52319ff3-1bb1-4d09-aa44-67ba79a834b3\") " pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:31.028656 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:31.028646    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:16:31.028800 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:31.028736    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:31.528714309 +0000 UTC m=+34.103817757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:16:31.029045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.029025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-tmp-dir\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.029247 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.029228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-config-volume\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.032782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.032651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52319ff3-1bb1-4d09-aa44-67ba79a834b3-cert\") pod \"ingress-canary-sghhm\" (UID: \"52319ff3-1bb1-4d09-aa44-67ba79a834b3\") " pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:31.037176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.037154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldnzb\" (UniqueName: \"kubernetes.io/projected/52319ff3-1bb1-4d09-aa44-67ba79a834b3-kube-api-access-ldnzb\") pod \"ingress-canary-sghhm\" (UID: \"52319ff3-1bb1-4d09-aa44-67ba79a834b3\") " pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:31.037654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.037633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxtz\" (UniqueName: \"kubernetes.io/projected/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-kube-api-access-dlxtz\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.146351 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.146295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sghhm"
Sep 11 18:16:31.150743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.150717    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5a03c55-dc50-44fd-84f5-3871564921b8" containerID="7a301bd50f2bf568b62fb194e442f10e4b1efc9fda29f5da2b0d2135a5d49ad8" exitCode=0
Sep 11 18:16:31.150846 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.150763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerDied","Data":"7a301bd50f2bf568b62fb194e442f10e4b1efc9fda29f5da2b0d2135a5d49ad8"}
Sep 11 18:16:31.476950 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.476881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sghhm"]
Sep 11 18:16:31.480140 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:16:31.480110    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52319ff3_1bb1_4d09_aa44_67ba79a834b3.slice/crio-a540fa1bf67ecafb28b42808635f5a3d89a5563faac752231aa923de2d0add24 WatchSource:0}: Error finding container a540fa1bf67ecafb28b42808635f5a3d89a5563faac752231aa923de2d0add24: Status 404 returned error can't find the container with id a540fa1bf67ecafb28b42808635f5a3d89a5563faac752231aa923de2d0add24
Sep 11 18:16:31.532201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:31.532178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:31.532345 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:31.532315    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:16:31.532394 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:31.532364    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:32.53234982 +0000 UTC m=+35.107453265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:16:32.155101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:32.155062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sghhm" event={"ID":"52319ff3-1bb1-4d09-aa44-67ba79a834b3","Type":"ContainerStarted","Data":"a540fa1bf67ecafb28b42808635f5a3d89a5563faac752231aa923de2d0add24"}
Sep 11 18:16:32.158806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:32.158777    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5a03c55-dc50-44fd-84f5-3871564921b8" containerID="473a7689e8566b95d6a35f02ab85d3b80d9619388f3234b70f1631cf116e6284" exitCode=0
Sep 11 18:16:32.158962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:32.158813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerDied","Data":"473a7689e8566b95d6a35f02ab85d3b80d9619388f3234b70f1631cf116e6284"}
Sep 11 18:16:32.539853 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:32.539815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:32.540035 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:32.539965    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:16:32.540096 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:32.540057    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:34.540029747 +0000 UTC m=+37.115133210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:16:33.165599 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:33.165341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5727l" event={"ID":"d5a03c55-dc50-44fd-84f5-3871564921b8","Type":"ContainerStarted","Data":"2130f82dc35d92f74a8f23f97f62e510a62036dd3f2ba83d6c817c97bba79a26"}
Sep 11 18:16:33.188839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:33.188776    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5727l" podStartSLOduration=7.357271374 podStartE2EDuration="35.188754608s" totalImagesPullingTime="27.831483234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:33.187477111 +0000 UTC m=+35.762580580" watchObservedRunningTime="2026-09-11 18:16:33.188754608 +0000 UTC m=+35.763858073"
Sep 11 18:16:33.317768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:33.317730    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:33.383775 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:33.383736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:34.169089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:34.169045    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sghhm" event={"ID":"52319ff3-1bb1-4d09-aa44-67ba79a834b3","Type":"ContainerStarted","Data":"d565642b10b730b55c7d2fe06a3496638f0425e70e00ecb8d42c2f4c77877e0d"}
Sep 11 18:16:34.186906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:34.186865    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sghhm" podStartSLOduration=1.959832786 podStartE2EDuration="4.186849467s" totalImagesPullingTime="2.227016681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:16:34.186473049 +0000 UTC m=+36.761576512" watchObservedRunningTime="2026-09-11 18:16:34.186849467 +0000 UTC m=+36.761952935"
Sep 11 18:16:34.555095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:34.555047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:34.555266 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:34.555205    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:16:34.555340 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:34.555270    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:38.555250413 +0000 UTC m=+41.130353864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:16:35.760003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:35.759959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:35.824778 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:35.824740    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:38.580926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:38.580881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:38.581287 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:38.581001    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:16:38.581287 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:38.581054    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:16:46.581039747 +0000 UTC m=+49.156143193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:16:44.615019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:44.614978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:44.690277 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:44.690240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:46.647907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:46.647870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:16:46.648409 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:46.647989    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:16:46.648409 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:16:46.648044    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:17:02.648029552 +0000 UTC m=+65.223132998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:16:56.145233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:56.145200    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qcpn"
Sep 11 18:16:56.322389 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:56.322356    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:16:56.420093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:16:56.420015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:02.558067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.558012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:17:02.560754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.560726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 18:17:02.568998 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:17:02.568981    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 18:17:02.569061 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:17:02.569054    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:06.569030812 +0000 UTC m=+129.144134261 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : secret "metrics-daemon-secret" not found
Sep 11 18:17:02.658587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.658526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:17:02.658751 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.658616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:17:02.658751 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:17:02.658702    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:17:02.658817 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:17:02.658758    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:17:34.658743913 +0000 UTC m=+97.233847358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:17:02.662388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.662367    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 18:17:02.672124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.672094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4586932-39b2-43d4-a6cf-f70b1241d20f-original-pull-secret\") pod \"global-pull-secret-syncer-6sbx8\" (UID: \"f4586932-39b2-43d4-a6cf-f70b1241d20f\") " pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:17:02.720779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.720733    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sbx8"
Sep 11 18:17:02.759407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.759366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:17:02.762839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.762812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 18:17:02.773490 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.773467    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 18:17:02.783603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.783556    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/f0eeefc0-31c9-461c-8de3-986e4529e7d1-kube-api-access-5jqgw\") pod \"network-check-target-w7n49\" (UID: \"f0eeefc0-31c9-461c-8de3-986e4529e7d1\") " pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:17:02.990733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:02.990651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6sbx8"]
Sep 11 18:17:02.994498 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:17:02.994462    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4586932_39b2_43d4_a6cf_f70b1241d20f.slice/crio-9d2f960a520ebcb9081ce953f66301ff235d737cc88eec8bc5581d540ff9b232 WatchSource:0}: Error finding container 9d2f960a520ebcb9081ce953f66301ff235d737cc88eec8bc5581d540ff9b232: Status 404 returned error can't find the container with id 9d2f960a520ebcb9081ce953f66301ff235d737cc88eec8bc5581d540ff9b232
Sep 11 18:17:03.012551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:03.012522    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-76gd9\""
Sep 11 18:17:03.021071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:03.021049    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:17:03.239698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:03.239662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6sbx8" event={"ID":"f4586932-39b2-43d4-a6cf-f70b1241d20f","Type":"ContainerStarted","Data":"9d2f960a520ebcb9081ce953f66301ff235d737cc88eec8bc5581d540ff9b232"}
Sep 11 18:17:03.293084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:03.293054    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w7n49"]
Sep 11 18:17:03.296373 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:17:03.296347    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0eeefc0_31c9_461c_8de3_986e4529e7d1.slice/crio-3f51e07977486fac9aff976553365b85d0174b9d3ed9f691ed6aca949e668284 WatchSource:0}: Error finding container 3f51e07977486fac9aff976553365b85d0174b9d3ed9f691ed6aca949e668284: Status 404 returned error can't find the container with id 3f51e07977486fac9aff976553365b85d0174b9d3ed9f691ed6aca949e668284
Sep 11 18:17:04.244460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:04.244428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w7n49" event={"ID":"f0eeefc0-31c9-461c-8de3-986e4529e7d1","Type":"ContainerStarted","Data":"3f51e07977486fac9aff976553365b85d0174b9d3ed9f691ed6aca949e668284"}
Sep 11 18:17:08.255103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:08.255064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6sbx8" event={"ID":"f4586932-39b2-43d4-a6cf-f70b1241d20f","Type":"ContainerStarted","Data":"7f05c8ebed685de24619a407261cdb662214835a1eed4b615a51fb743bad0075"}
Sep 11 18:17:08.256551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:08.256523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w7n49" event={"ID":"f0eeefc0-31c9-461c-8de3-986e4529e7d1","Type":"ContainerStarted","Data":"96b4c5814ea413b5e76cd98c62e03f40808378a69d6ee3821f5864a8d8d54636"}
Sep 11 18:17:08.256667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:08.256583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:17:08.271978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:08.271932    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6sbx8" podStartSLOduration=65.533512832 podStartE2EDuration="1m10.271916139s" totalImagesPullingTime="4.738403307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:08.271862344 +0000 UTC m=+70.846965812" watchObservedRunningTime="2026-09-11 18:17:08.271916139 +0000 UTC m=+70.847019607"
Sep 11 18:17:08.289015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:08.288968    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w7n49" podStartSLOduration=65.855346938 podStartE2EDuration="1m10.288952136s" totalImagesPullingTime="4.433605198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:17:08.288332567 +0000 UTC m=+70.863436036" watchObservedRunningTime="2026-09-11 18:17:08.288952136 +0000 UTC m=+70.864055603"
Sep 11 18:17:23.178715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:23.178586    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:24.431879 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:24.431846    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:17:34.673873 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:34.673824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:17:34.674426 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:17:34.674402    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:17:34.674558 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:17:34.674545    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls podName:dabbd38b-95eb-48b5-b74c-a87f82e02ac7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:38.674522402 +0000 UTC m=+161.249625863 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls") pod "dns-default-mxg7k" (UID: "dabbd38b-95eb-48b5-b74c-a87f82e02ac7") : secret "dns-default-metrics-tls" not found
Sep 11 18:17:39.262450 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:17:39.262420    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w7n49"
Sep 11 18:18:00.250847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.250811    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"]
Sep 11 18:18:00.252784 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.252767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.255957 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.255936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 18:18:00.258161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.258140    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 18:18:00.258264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.258181    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 18:18:00.258264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.258227    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 18:18:00.258390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.258283    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xkgpg\""
Sep 11 18:18:00.268763 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.268737    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"]
Sep 11 18:18:00.347337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.347289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8bns\" (UniqueName: \"kubernetes.io/projected/516c07df-f9a7-48a7-8cd4-b992f37bfb44-kube-api-access-j8bns\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.347337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.347344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/516c07df-f9a7-48a7-8cd4-b992f37bfb44-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.347571 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.347401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.448158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.448127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.448364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.448209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8bns\" (UniqueName: \"kubernetes.io/projected/516c07df-f9a7-48a7-8cd4-b992f37bfb44-kube-api-access-j8bns\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.448364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.448248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/516c07df-f9a7-48a7-8cd4-b992f37bfb44-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.448364 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.448282    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:00.448665 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.448370    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls podName:516c07df-f9a7-48a7-8cd4-b992f37bfb44 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:00.948347386 +0000 UTC m=+123.523450847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-7d9zn" (UID: "516c07df-f9a7-48a7-8cd4-b992f37bfb44") : secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:00.449129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.449110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/516c07df-f9a7-48a7-8cd4-b992f37bfb44-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.453798 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.453773    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"]
Sep 11 18:18:00.455563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.455545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"
Sep 11 18:18:00.458178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.458159    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wzcv7\""
Sep 11 18:18:00.458280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.458267    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:18:00.458362 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.458355    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 18:18:00.464025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.464007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8bns\" (UniqueName: \"kubernetes.io/projected/516c07df-f9a7-48a7-8cd4-b992f37bfb44-kube-api-access-j8bns\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.470334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.470287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"]
Sep 11 18:18:00.521089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.520999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:00.548683 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.548652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvs7\" (UniqueName: \"kubernetes.io/projected/9950d4ec-d924-47f5-939d-298206407d73-kube-api-access-xwvs7\") pod \"volume-data-source-validator-86695b7cc7-f272x\" (UID: \"9950d4ec-d924-47f5-939d-298206407d73\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"
Sep 11 18:18:00.557426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.557399    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"]
Sep 11 18:18:00.559332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.559316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.563486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.563466    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 18:18:00.563596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.563504    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 18:18:00.563596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.563517    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9wmk8\""
Sep 11 18:18:00.563596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.563586    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:18:00.563900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.563884    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 18:18:00.571190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.571162    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"]
Sep 11 18:18:00.602535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.602506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:00.649589 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.649560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.649684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.649594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97kk\" (UniqueName: \"kubernetes.io/projected/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-kube-api-access-f97kk\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.649684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.649653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvs7\" (UniqueName: \"kubernetes.io/projected/9950d4ec-d924-47f5-939d-298206407d73-kube-api-access-xwvs7\") pod \"volume-data-source-validator-86695b7cc7-f272x\" (UID: \"9950d4ec-d924-47f5-939d-298206407d73\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"
Sep 11 18:18:00.649765 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.649700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.658454 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.658425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvs7\" (UniqueName: \"kubernetes.io/projected/9950d4ec-d924-47f5-939d-298206407d73-kube-api-access-xwvs7\") pod \"volume-data-source-validator-86695b7cc7-f272x\" (UID: \"9950d4ec-d924-47f5-939d-298206407d73\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"
Sep 11 18:18:00.660535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.660511    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7658f5756d-ct5v9"]
Sep 11 18:18:00.662881 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.662863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.665524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.665505    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 18:18:00.665632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.665531    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 18:18:00.665632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.665613    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 18:18:00.665739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.665724    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9p5l\""
Sep 11 18:18:00.671585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.671567    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 18:18:00.675572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.675553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7658f5756d-ct5v9"]
Sep 11 18:18:00.750147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750116    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.750294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-trusted-ca\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-installation-pull-secrets\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.750294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97kk\" (UniqueName: \"kubernetes.io/projected/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-kube-api-access-f97kk\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.750294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-bound-sa-token\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxvmw\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-kube-api-access-mxvmw\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ca8269-6872-41ab-85d7-57ef7c9918e2-ca-trust-extracted\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-image-registry-private-configuration\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-certificates\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.750827 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.750759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.752462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.752440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.758443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.758424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97kk\" (UniqueName: \"kubernetes.io/projected/0a7aaf45-091b-4d43-93a5-cbf82c41c08c-kube-api-access-f97kk\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wrqdh\" (UID: \"0a7aaf45-091b-4d43-93a5-cbf82c41c08c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.764321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.764290    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"
Sep 11 18:18:00.850890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.850854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-bound-sa-token\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.850890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.850892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxvmw\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-kube-api-access-mxvmw\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.850915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ca8269-6872-41ab-85d7-57ef7c9918e2-ca-trust-extracted\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-image-registry-private-configuration\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-certificates\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-trusted-ca\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851229 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-installation-pull-secrets\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851279 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ca8269-6872-41ab-85d7-57ef7c9918e2-ca-trust-extracted\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.851411 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.851361    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:18:00.851411 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.851380    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7658f5756d-ct5v9: secret "image-registry-tls" not found
Sep 11 18:18:00.851509 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.851432    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls podName:f6ca8269-6872-41ab-85d7-57ef7c9918e2 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:01.351413387 +0000 UTC m=+123.926516849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls") pod "image-registry-7658f5756d-ct5v9" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2") : secret "image-registry-tls" not found
Sep 11 18:18:00.851817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.851795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-certificates\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.852265 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.852243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-trusted-ca\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.853426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.853403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-image-registry-private-configuration\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.853509 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.853432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-installation-pull-secrets\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.861782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.861755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-bound-sa-token\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.861908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.861893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxvmw\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-kube-api-access-mxvmw\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:00.868633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.868617    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"
Sep 11 18:18:00.951590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:00.951563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:00.951723 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.951701    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:00.951776 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:00.951766    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls podName:516c07df-f9a7-48a7-8cd4-b992f37bfb44 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:01.951749458 +0000 UTC m=+124.526852915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-7d9zn" (UID: "516c07df-f9a7-48a7-8cd4-b992f37bfb44") : secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:01.032499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:01.032425    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x"]
Sep 11 18:18:01.035489 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:01.035460    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9950d4ec_d924_47f5_939d_298206407d73.slice/crio-45069b3c612128c22d21c73f26fba5094089824dc0e863887e9156b113487467 WatchSource:0}: Error finding container 45069b3c612128c22d21c73f26fba5094089824dc0e863887e9156b113487467: Status 404 returned error can't find the container with id 45069b3c612128c22d21c73f26fba5094089824dc0e863887e9156b113487467
Sep 11 18:18:01.136701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:01.136669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh"]
Sep 11 18:18:01.139960 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:01.139919    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7aaf45_091b_4d43_93a5_cbf82c41c08c.slice/crio-5b7fcb752b3ac0e31e1a1a3ec3f5941e7b793eef2d6f79a678ff1fad1e3b403d WatchSource:0}: Error finding container 5b7fcb752b3ac0e31e1a1a3ec3f5941e7b793eef2d6f79a678ff1fad1e3b403d: Status 404 returned error can't find the container with id 5b7fcb752b3ac0e31e1a1a3ec3f5941e7b793eef2d6f79a678ff1fad1e3b403d
Sep 11 18:18:01.353806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:01.353700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:01.354264 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:01.353881    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:18:01.354264 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:01.353906    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7658f5756d-ct5v9: secret "image-registry-tls" not found
Sep 11 18:18:01.354264 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:01.353992    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls podName:f6ca8269-6872-41ab-85d7-57ef7c9918e2 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:02.353972152 +0000 UTC m=+124.929075600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls") pod "image-registry-7658f5756d-ct5v9" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2") : secret "image-registry-tls" not found
Sep 11 18:18:01.387204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:01.387169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh" event={"ID":"0a7aaf45-091b-4d43-93a5-cbf82c41c08c","Type":"ContainerStarted","Data":"5b7fcb752b3ac0e31e1a1a3ec3f5941e7b793eef2d6f79a678ff1fad1e3b403d"}
Sep 11 18:18:01.388344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:01.388321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x" event={"ID":"9950d4ec-d924-47f5-939d-298206407d73","Type":"ContainerStarted","Data":"45069b3c612128c22d21c73f26fba5094089824dc0e863887e9156b113487467"}
Sep 11 18:18:01.958677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:01.958634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:01.958846 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:01.958784    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:01.958887 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:01.958874    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls podName:516c07df-f9a7-48a7-8cd4-b992f37bfb44 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:03.958856565 +0000 UTC m=+126.533960027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-7d9zn" (UID: "516c07df-f9a7-48a7-8cd4-b992f37bfb44") : secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:02.284141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.284100    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"]
Sep 11 18:18:02.286104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.286080    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.288570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.288543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 18:18:02.288710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.288591    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 18:18:02.288710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.288617    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5s5qc\""
Sep 11 18:18:02.288710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.288617    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:18:02.289499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.289477    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 18:18:02.296661 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.296638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"]
Sep 11 18:18:02.361953 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.361912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqg4\" (UniqueName: \"kubernetes.io/projected/b2dc5885-bf5d-491b-9635-a27997baec44-kube-api-access-vlqg4\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.362382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.361973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:02.362382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.362061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2dc5885-bf5d-491b-9635-a27997baec44-config\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.362382 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:02.362077    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:18:02.362382 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:02.362092    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7658f5756d-ct5v9: secret "image-registry-tls" not found
Sep 11 18:18:02.362382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.362102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2dc5885-bf5d-491b-9635-a27997baec44-serving-cert\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.362382 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:02.362156    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls podName:f6ca8269-6872-41ab-85d7-57ef7c9918e2 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:04.362135923 +0000 UTC m=+126.937239377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls") pod "image-registry-7658f5756d-ct5v9" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2") : secret "image-registry-tls" not found
Sep 11 18:18:02.463607 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.463572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqg4\" (UniqueName: \"kubernetes.io/projected/b2dc5885-bf5d-491b-9635-a27997baec44-kube-api-access-vlqg4\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.463795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.463638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2dc5885-bf5d-491b-9635-a27997baec44-config\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.463795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.463669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2dc5885-bf5d-491b-9635-a27997baec44-serving-cert\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.464316 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.464277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2dc5885-bf5d-491b-9635-a27997baec44-config\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.466092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.466065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2dc5885-bf5d-491b-9635-a27997baec44-serving-cert\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.473203 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.473177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqg4\" (UniqueName: \"kubernetes.io/projected/b2dc5885-bf5d-491b-9635-a27997baec44-kube-api-access-vlqg4\") pod \"service-ca-operator-cf7c776b7-6j2zs\" (UID: \"b2dc5885-bf5d-491b-9635-a27997baec44\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.597741 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.597712    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"
Sep 11 18:18:02.877534 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:02.877453    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs"]
Sep 11 18:18:03.198443 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:03.198381    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dc5885_bf5d_491b_9635_a27997baec44.slice/crio-076fd2c28679ff093985f95e816da9dad1556aa36430cc456051e022c0d305eb WatchSource:0}: Error finding container 076fd2c28679ff093985f95e816da9dad1556aa36430cc456051e022c0d305eb: Status 404 returned error can't find the container with id 076fd2c28679ff093985f95e816da9dad1556aa36430cc456051e022c0d305eb
Sep 11 18:18:03.396026 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.395979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x" event={"ID":"9950d4ec-d924-47f5-939d-298206407d73","Type":"ContainerStarted","Data":"3d18cd3b6f0aed29cb9cae1a2139560facf32e081deec7691881d58a58a0e4d9"}
Sep 11 18:18:03.397213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.397183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs" event={"ID":"b2dc5885-bf5d-491b-9635-a27997baec44","Type":"ContainerStarted","Data":"076fd2c28679ff093985f95e816da9dad1556aa36430cc456051e022c0d305eb"}
Sep 11 18:18:03.398648 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.398628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh" event={"ID":"0a7aaf45-091b-4d43-93a5-cbf82c41c08c","Type":"ContainerStarted","Data":"fa69ba3301e63276411a3de4908669806e2a7dca2107e295c9dc7fe4f347dd1a"}
Sep 11 18:18:03.412276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.412232    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f272x" podStartSLOduration=1.876368765 podStartE2EDuration="3.412217664s" totalImagesPullingTime="1.535848899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:03.411650622 +0000 UTC m=+125.986754090" watchObservedRunningTime="2026-09-11 18:18:03.412217664 +0000 UTC m=+125.987321127"
Sep 11 18:18:03.431259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.431218    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh" podStartSLOduration=1.343933408 podStartE2EDuration="3.431204898s" totalImagesPullingTime="2.08727149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:03.430179189 +0000 UTC m=+126.005282659" watchObservedRunningTime="2026-09-11 18:18:03.431204898 +0000 UTC m=+126.006308365"
Sep 11 18:18:03.505354 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.505324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:03.618836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.618804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:03.978147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:03.978057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:03.978338 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:03.978231    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:03.978413 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:03.978339    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls podName:516c07df-f9a7-48a7-8cd4-b992f37bfb44 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:07.978316928 +0000 UTC m=+130.553420391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-7d9zn" (UID: "516c07df-f9a7-48a7-8cd4-b992f37bfb44") : secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:04.382176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:04.382137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:04.382370 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:04.382313    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:18:04.382370 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:04.382333    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7658f5756d-ct5v9: secret "image-registry-tls" not found
Sep 11 18:18:04.382451 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:04.382399    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls podName:f6ca8269-6872-41ab-85d7-57ef7c9918e2 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:08.382382084 +0000 UTC m=+130.957485548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls") pod "image-registry-7658f5756d-ct5v9" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2") : secret "image-registry-tls" not found
Sep 11 18:18:05.028044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.028002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:05.123429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.123395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:05.406816 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.406771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs" event={"ID":"b2dc5885-bf5d-491b-9635-a27997baec44","Type":"ContainerStarted","Data":"430e8593463bc5d530a9e4b34eed93694e0f8b517379c74125d4a049f38fe288"}
Sep 11 18:18:05.445470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.445415    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs" podStartSLOduration=1.731645893 podStartE2EDuration="3.44539329s" totalImagesPullingTime="1.713747397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:05.429294932 +0000 UTC m=+128.004398401" watchObservedRunningTime="2026-09-11 18:18:05.44539329 +0000 UTC m=+128.020496760"
Sep 11 18:18:05.445661 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.445646    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kpvk7"]
Sep 11 18:18:05.448031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.448013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.450736 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.450706    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:05.452279 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.452258    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 18:18:05.452365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.452260    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 18:18:05.452484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.452463    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 18:18:05.452655 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.452633    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 18:18:05.453394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.453379    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wf5gj\""
Sep 11 18:18:05.464190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.464164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpvk7"]
Sep 11 18:18:05.519400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.519366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:05.594178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.594143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.594342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.594187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.594342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.594208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4lc9\" (UniqueName: \"kubernetes.io/projected/45631a58-13c6-453e-996c-478b17a551b7-kube-api-access-p4lc9\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.594342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.594292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45631a58-13c6-453e-996c-478b17a551b7-crio-socket\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.594505 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.594394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45631a58-13c6-453e-996c-478b17a551b7-data-volume\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.695491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.695402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.695491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.695461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.695492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4lc9\" (UniqueName: \"kubernetes.io/projected/45631a58-13c6-453e-996c-478b17a551b7-kube-api-access-p4lc9\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:05.695541    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:05.695570    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.695549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45631a58-13c6-453e-996c-478b17a551b7-crio-socket\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.695617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45631a58-13c6-453e-996c-478b17a551b7-crio-socket\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:05.695623    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:06.195603788 +0000 UTC m=+128.770707252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : configmap "kube-rbac-proxy" not found
Sep 11 18:18:05.695690 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:05.695646    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:06.195639486 +0000 UTC m=+128.770742933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:05.695962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.695722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45631a58-13c6-453e-996c-478b17a551b7-data-volume\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.696014 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.696000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45631a58-13c6-453e-996c-478b17a551b7-data-volume\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:05.704220 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:05.704194    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4lc9\" (UniqueName: \"kubernetes.io/projected/45631a58-13c6-453e-996c-478b17a551b7-kube-api-access-p4lc9\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:06.200204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.200167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:06.200204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.200205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:06.200636 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.200293    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:18:06.200636 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.200379    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:07.200362471 +0000 UTC m=+129.775465917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : configmap "kube-rbac-proxy" not found
Sep 11 18:18:06.200636 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.200320    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:06.200636 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.200451    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:07.200439164 +0000 UTC m=+129.775542611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:06.203002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.202978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:06.301081 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.301043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:06.432626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.432588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:06.513320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.513271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:06.576235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.576208    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"]
Sep 11 18:18:06.578183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.578167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:06.580647 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.580622    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 18:18:06.580782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.580674    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hqq8x\""
Sep 11 18:18:06.581017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.581001    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 18:18:06.593350 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.593328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"]
Sep 11 18:18:06.603641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.603616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:18:06.603747 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.603725    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 18:18:06.603793 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.603775    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs podName:eaafbc73-c564-4e71-81ac-eb55aba7b147 nodeName:}" failed. No retries permitted until 2026-09-11 18:20:08.603761146 +0000 UTC m=+251.178864591 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs") pod "network-metrics-daemon-vxrl6" (UID: "eaafbc73-c564-4e71-81ac-eb55aba7b147") : secret "metrics-daemon-secret" not found
Sep 11 18:18:06.704838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.704794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:06.704838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.704848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c465316-3fad-4e66-83ba-a33c18b0b503-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:06.805365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.805266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:06.805365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.805334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c465316-3fad-4e66-83ba-a33c18b0b503-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:06.805546 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.805410    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:18:06.805546 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:06.805470    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert podName:3c465316-3fad-4e66-83ba-a33c18b0b503 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:07.305454859 +0000 UTC m=+129.880558305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xjdql" (UID: "3c465316-3fad-4e66-83ba-a33c18b0b503") : secret "networking-console-plugin-cert" not found
Sep 11 18:18:06.805958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.805938    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c465316-3fad-4e66-83ba-a33c18b0b503-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:06.912527 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:06.912494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:07.025090 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:07.025055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:07.208749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:07.208673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:07.208749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:07.208726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:07.209154 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:07.208795    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:18:07.209154 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:07.208834    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:07.209154 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:07.208867    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:09.208851218 +0000 UTC m=+131.783954664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : configmap "kube-rbac-proxy" not found
Sep 11 18:18:07.209154 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:07.208890    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:09.208873004 +0000 UTC m=+131.783976473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:07.309767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:07.309728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:07.309935 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:07.309867    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:18:07.309976 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:07.309941    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert podName:3c465316-3fad-4e66-83ba-a33c18b0b503 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:08.309923352 +0000 UTC m=+130.885026805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xjdql" (UID: "3c465316-3fad-4e66-83ba-a33c18b0b503") : secret "networking-console-plugin-cert" not found
Sep 11 18:18:07.820106 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:07.820065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:07.921100 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:07.921065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:08.000541 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.000513    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c7srq_476947be-d290-49b9-b5c3-65b974645c5c/dns-node-resolver/0.log"
Sep 11 18:18:08.015844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.015819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:08.015968 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.015954    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:08.016022 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.016011    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls podName:516c07df-f9a7-48a7-8cd4-b992f37bfb44 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:16.015996558 +0000 UTC m=+138.591100004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-7d9zn" (UID: "516c07df-f9a7-48a7-8cd4-b992f37bfb44") : secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:08.318007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.317968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:08.318377 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.318137    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:18:08.318377 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.318206    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert podName:3c465316-3fad-4e66-83ba-a33c18b0b503 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:10.318189854 +0000 UTC m=+132.893293299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xjdql" (UID: "3c465316-3fad-4e66-83ba-a33c18b0b503") : secret "networking-console-plugin-cert" not found
Sep 11 18:18:08.419185 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.419153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:08.419362 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.419316    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:18:08.419362 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.419338    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7658f5756d-ct5v9: secret "image-registry-tls" not found
Sep 11 18:18:08.419442 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:08.419392    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls podName:f6ca8269-6872-41ab-85d7-57ef7c9918e2 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:16.419375827 +0000 UTC m=+138.994479277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls") pod "image-registry-7658f5756d-ct5v9" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2") : secret "image-registry-tls" not found
Sep 11 18:18:08.608151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.608064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:08.781669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.781632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:08.992316 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:08.992222    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ml5b_4d432658-3f35-41e4-ab4a-d24fd02d2b59/node-ca/0.log"
Sep 11 18:18:09.226263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:09.226222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:09.226466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:09.226269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:09.226466 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:09.226371    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:18:09.226466 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:09.226434    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:13.226418667 +0000 UTC m=+135.801522113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : configmap "kube-rbac-proxy" not found
Sep 11 18:18:09.226586 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:09.226465    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:09.226586 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:09.226523    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:13.226508817 +0000 UTC m=+135.801612278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:09.737843 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:09.737798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:09.793535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:09.793509    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sghhm_52319ff3-1bb1-4d09-aa44-67ba79a834b3/serve-healthcheck-canary/0.log"
Sep 11 18:18:10.335106 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:10.335069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:10.335287 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:10.335216    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:18:10.335287 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:10.335282    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert podName:3c465316-3fad-4e66-83ba-a33c18b0b503 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:14.335266503 +0000 UTC m=+136.910369974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xjdql" (UID: "3c465316-3fad-4e66-83ba-a33c18b0b503") : secret "networking-console-plugin-cert" not found
Sep 11 18:18:10.801404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:10.801368    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wrqdh_0a7aaf45-091b-4d43-93a5-cbf82c41c08c/kube-storage-version-migrator-operator/0.log"
Sep 11 18:18:12.445478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:12.445440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:12.596405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:12.596372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:12.741564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:12.741468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:12.825436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:12.825394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:13.177652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:13.177616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:13.261925 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:13.261895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:13.261925 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:13.261933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:13.262125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:13.262020    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:18:13.262125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:13.262075    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:13.262125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:13.262094    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:21.262078305 +0000 UTC m=+143.837181765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : configmap "kube-rbac-proxy" not found
Sep 11 18:18:13.262125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:13.262118    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:21.262106956 +0000 UTC m=+143.837210402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:13.277321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:13.277276    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:13.794564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:13.794530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:13.870365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:13.870330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:14.368624 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:14.368577    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:14.368830 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:14.368698    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 18:18:14.368830 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:14.368754    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert podName:3c465316-3fad-4e66-83ba-a33c18b0b503 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:22.368740909 +0000 UTC m=+144.943844355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xjdql" (UID: "3c465316-3fad-4e66-83ba-a33c18b0b503") : secret "networking-console-plugin-cert" not found
Sep 11 18:18:14.542385 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:14.542352    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:14.748722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:14.748627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:14.941445 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:14.941408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:15.139029 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:15.138987    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:15.601429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:15.601397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:15.731869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:15.731826    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:16.084212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:16.084181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:16.084596 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:16.084352    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:16.084596 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:16.084417    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls podName:516c07df-f9a7-48a7-8cd4-b992f37bfb44 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:32.084400664 +0000 UTC m=+154.659504121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-7d9zn" (UID: "516c07df-f9a7-48a7-8cd4-b992f37bfb44") : secret "cluster-monitoring-operator-tls" not found
Sep 11 18:18:16.341315 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:16.341218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:16.486923 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:16.486870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:16.487099 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:16.487011    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:18:16.487099 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:16.487030    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7658f5756d-ct5v9: secret "image-registry-tls" not found
Sep 11 18:18:16.487099 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:16.487087    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls podName:f6ca8269-6872-41ab-85d7-57ef7c9918e2 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:32.487072312 +0000 UTC m=+155.062175758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls") pod "image-registry-7658f5756d-ct5v9" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2") : secret "image-registry-tls" not found
Sep 11 18:18:16.656328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:16.656209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:16.742901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:16.742860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:17.148872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:17.148837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:17.542175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:17.542144    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:17.677869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:17.677828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:17.940941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:17.940848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:18.169178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:18.169147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:18.270641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:18.270609    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:18.766728 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:18.766698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:19.158177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:19.158088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:19.536606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:19.536570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:19.766785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:19.766756    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:19.868280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:19.868195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:19.969359 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:19.969324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:20.137020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:20.136928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:20.742106 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:20.742068    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:21.324321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.324271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:21.324522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.324395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:21.324522 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:21.324429    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:21.324522 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:21.324494    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls podName:45631a58-13c6-453e-996c-478b17a551b7 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:37.324477547 +0000 UTC m=+159.899580993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpvk7" (UID: "45631a58-13c6-453e-996c-478b17a551b7") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:18:21.324861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.324846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45631a58-13c6-453e-996c-478b17a551b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:21.336194 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.336161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:21.443574 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.443540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:21.545140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.545107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:21.734928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.734835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:21.945408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:21.945374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:22.432973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:22.432925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:22.435431 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:22.435407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c465316-3fad-4e66-83ba-a33c18b0b503-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xjdql\" (UID: \"3c465316-3fad-4e66-83ba-a33c18b0b503\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:22.486815 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:22.486778    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"
Sep 11 18:18:22.743233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:22.743152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:22.756291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:22.756264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql"]
Sep 11 18:18:22.758958 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:22.758928    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c465316_3fad_4e66_83ba_a33c18b0b503.slice/crio-d8541e998b31e327cbf60d437937705475b59b7ecd791598204c48703769197d WatchSource:0}: Error finding container d8541e998b31e327cbf60d437937705475b59b7ecd791598204c48703769197d: Status 404 returned error can't find the container with id d8541e998b31e327cbf60d437937705475b59b7ecd791598204c48703769197d
Sep 11 18:18:22.937866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:22.937815    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:23.273739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:23.273701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:23.460897 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:23.460859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql" event={"ID":"3c465316-3fad-4e66-83ba-a33c18b0b503","Type":"ContainerStarted","Data":"d8541e998b31e327cbf60d437937705475b59b7ecd791598204c48703769197d"}
Sep 11 18:18:24.464787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:24.464750    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql" event={"ID":"3c465316-3fad-4e66-83ba-a33c18b0b503","Type":"ContainerStarted","Data":"4af40c0f6ad27b0e72827c2014fbc4a9fc830111fe9fede8357321a8ab853ffb"}
Sep 11 18:18:24.484043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:24.483990    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xjdql" podStartSLOduration=17.456063118 podStartE2EDuration="18.483974819s" totalImagesPullingTime="1.027911701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:24.482957098 +0000 UTC m=+147.058060565" watchObservedRunningTime="2026-09-11 18:18:24.483974819 +0000 UTC m=+147.059078286"
Sep 11 18:18:30.766991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.766957    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7658f5756d-ct5v9"]
Sep 11 18:18:30.767503 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:30.767190    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7658f5756d-ct5v9" podUID="f6ca8269-6872-41ab-85d7-57ef7c9918e2"
Sep 11 18:18:30.813642 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.813615    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-764fdbb777-b6xj5"]
Sep 11 18:18:30.816500 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.816482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.843737 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.843710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764fdbb777-b6xj5"]
Sep 11 18:18:30.904169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50895c0c-4b84-42d4-b964-1328e7af6dad-trusted-ca\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-bound-sa-token\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-registry-tls\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50895c0c-4b84-42d4-b964-1328e7af6dad-image-registry-private-configuration\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904515 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50895c0c-4b84-42d4-b964-1328e7af6dad-registry-certificates\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904515 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx8fh\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-kube-api-access-lx8fh\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50895c0c-4b84-42d4-b964-1328e7af6dad-installation-pull-secrets\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.904588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.904575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50895c0c-4b84-42d4-b964-1328e7af6dad-ca-trust-extracted\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:30.927478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:30.927446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:31.004901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.004871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-registry-tls\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.004901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.004905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50895c0c-4b84-42d4-b964-1328e7af6dad-image-registry-private-configuration\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.004976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50895c0c-4b84-42d4-b964-1328e7af6dad-registry-certificates\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.005004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx8fh\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-kube-api-access-lx8fh\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.005040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50895c0c-4b84-42d4-b964-1328e7af6dad-installation-pull-secrets\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.005075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50895c0c-4b84-42d4-b964-1328e7af6dad-ca-trust-extracted\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.005111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50895c0c-4b84-42d4-b964-1328e7af6dad-trusted-ca\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.005136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-bound-sa-token\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.005617 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.005588    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50895c0c-4b84-42d4-b964-1328e7af6dad-ca-trust-extracted\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.006108 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.006084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50895c0c-4b84-42d4-b964-1328e7af6dad-registry-certificates\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.006398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.006371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50895c0c-4b84-42d4-b964-1328e7af6dad-trusted-ca\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.007620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.007598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50895c0c-4b84-42d4-b964-1328e7af6dad-image-registry-private-configuration\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.007714 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.007663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-registry-tls\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.007803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.007779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50895c0c-4b84-42d4-b964-1328e7af6dad-installation-pull-secrets\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.016451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.016419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx8fh\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-kube-api-access-lx8fh\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.017478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.017433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50895c0c-4b84-42d4-b964-1328e7af6dad-bound-sa-token\") pod \"image-registry-764fdbb777-b6xj5\" (UID: \"50895c0c-4b84-42d4-b964-1328e7af6dad\") " pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.026022 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.025997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:31.124946 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.124918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.126321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.126282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:31.398524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.398447    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764fdbb777-b6xj5"]
Sep 11 18:18:31.401788 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:31.401764    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50895c0c_4b84_42d4_b964_1328e7af6dad.slice/crio-112aa85f6ef46a354cac8c8ad61c336b5c3944b1491016b92dc770d279423975 WatchSource:0}: Error finding container 112aa85f6ef46a354cac8c8ad61c336b5c3944b1491016b92dc770d279423975: Status 404 returned error can't find the container with id 112aa85f6ef46a354cac8c8ad61c336b5c3944b1491016b92dc770d279423975
Sep 11 18:18:31.486496 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.486466    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:31.486616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.486496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5" event={"ID":"50895c0c-4b84-42d4-b964-1328e7af6dad","Type":"ContainerStarted","Data":"69b6859c1e0760db10a23599c6ef60b94b5193df3d14f6c525bff3b3563797d9"}
Sep 11 18:18:31.486616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.486546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5" event={"ID":"50895c0c-4b84-42d4-b964-1328e7af6dad","Type":"ContainerStarted","Data":"112aa85f6ef46a354cac8c8ad61c336b5c3944b1491016b92dc770d279423975"}
Sep 11 18:18:31.486616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.486568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:31.492767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.492748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:31.512773 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.512728    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5" podStartSLOduration=1.512714031 podStartE2EDuration="1.512714031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:31.510959677 +0000 UTC m=+154.086063155" watchObservedRunningTime="2026-09-11 18:18:31.512714031 +0000 UTC m=+154.087817498"
Sep 11 18:18:31.610110 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610069    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-trusted-ca\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610110 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ca8269-6872-41ab-85d7-57ef7c9918e2-ca-trust-extracted\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610151    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-image-registry-private-configuration\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-certificates\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxvmw\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-kube-api-access-mxvmw\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610342    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-bound-sa-token\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-installation-pull-secrets\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:31.610595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610443    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ca8269-6872-41ab-85d7-57ef7c9918e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:18:31.610595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:18:31.610875 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610852    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-trusted-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:31.610971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.610878    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ca8269-6872-41ab-85d7-57ef7c9918e2-ca-trust-extracted\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:31.611048 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.611011    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:18:31.612937 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.612905    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:18:31.613050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.612958    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-kube-api-access-mxvmw" (OuterVolumeSpecName: "kube-api-access-mxvmw") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "kube-api-access-mxvmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:31.613050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.612980    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:31.613050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.612989    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:18:31.711582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.711516    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-image-registry-private-configuration\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:31.711582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.711544    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-certificates\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:31.711582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.711554    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxvmw\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-kube-api-access-mxvmw\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:31.711582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.711562    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-bound-sa-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:31.711582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:31.711571    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ca8269-6872-41ab-85d7-57ef7c9918e2-installation-pull-secrets\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:32.115320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.115268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:32.117815 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.117787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/516c07df-f9a7-48a7-8cd4-b992f37bfb44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-7d9zn\" (UID: \"516c07df-f9a7-48a7-8cd4-b992f37bfb44\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:32.361657 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.361553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"
Sep 11 18:18:32.489849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.489817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:32.519157 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.519129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:32.521537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.521510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"image-registry-7658f5756d-ct5v9\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") " pod="openshift-image-registry/image-registry-7658f5756d-ct5v9"
Sep 11 18:18:32.523878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.523856    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7658f5756d-ct5v9"]
Sep 11 18:18:32.530650 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.530630    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7658f5756d-ct5v9"]
Sep 11 18:18:32.619987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.619922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") pod \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\" (UID: \"f6ca8269-6872-41ab-85d7-57ef7c9918e2\") "
Sep 11 18:18:32.622016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.621993    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f6ca8269-6872-41ab-85d7-57ef7c9918e2" (UID: "f6ca8269-6872-41ab-85d7-57ef7c9918e2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:18:32.634769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.634727    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn"]
Sep 11 18:18:32.636809 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:32.636784    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516c07df_f9a7_48a7_8cd4_b992f37bfb44.slice/crio-ba91c800b576fcfcbb1271ea5f14f2c748a1685009b37ecf82acc18c5e20a73c WatchSource:0}: Error finding container ba91c800b576fcfcbb1271ea5f14f2c748a1685009b37ecf82acc18c5e20a73c: Status 404 returned error can't find the container with id ba91c800b576fcfcbb1271ea5f14f2c748a1685009b37ecf82acc18c5e20a73c
Sep 11 18:18:32.721249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:32.721217    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ca8269-6872-41ab-85d7-57ef7c9918e2-registry-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:18:33.495282 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:33.495193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn" event={"ID":"516c07df-f9a7-48a7-8cd4-b992f37bfb44","Type":"ContainerStarted","Data":"ba91c800b576fcfcbb1271ea5f14f2c748a1685009b37ecf82acc18c5e20a73c"}
Sep 11 18:18:33.823054 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:33.823017    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mxg7k" podUID="dabbd38b-95eb-48b5-b74c-a87f82e02ac7"
Sep 11 18:18:33.906675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:33.906632    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ca8269-6872-41ab-85d7-57ef7c9918e2" path="/var/lib/kubelet/pods/f6ca8269-6872-41ab-85d7-57ef7c9918e2/volumes"
Sep 11 18:18:33.917011 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:33.916969    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vxrl6" podUID="eaafbc73-c564-4e71-81ac-eb55aba7b147"
Sep 11 18:18:34.500235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.500195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn" event={"ID":"516c07df-f9a7-48a7-8cd4-b992f37bfb44","Type":"ContainerStarted","Data":"569843fa3d3fdedae5c187d8ec6a279fe6b7565756a3b73a90d78f7991693c60"}
Sep 11 18:18:34.500712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.500288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:18:34.517643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.517452    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-7d9zn" podStartSLOduration=32.829155274 podStartE2EDuration="34.51743292s" totalImagesPullingTime="1.688277646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:34.51704309 +0000 UTC m=+157.092146558" watchObservedRunningTime="2026-09-11 18:18:34.51743292 +0000 UTC m=+157.092536387"
Sep 11 18:18:34.643945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.643914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:34.743095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.743064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:34.861940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.861897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:34.865350 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.865323    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"]
Sep 11 18:18:34.868284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.868267    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:34.871360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.871336    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 18:18:34.871651 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.871638    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bf4f8\""
Sep 11 18:18:34.879538 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.879478    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"]
Sep 11 18:18:34.938373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.938335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8133809f-7e9a-41be-979c-034f56afb570-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-9t8k6\" (UID: \"8133809f-7e9a-41be-979c-034f56afb570\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:34.972032 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:34.971991    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:35.039401 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:35.039375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8133809f-7e9a-41be-979c-034f56afb570-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-9t8k6\" (UID: \"8133809f-7e9a-41be-979c-034f56afb570\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:35.041796 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:35.041766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8133809f-7e9a-41be-979c-034f56afb570-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-9t8k6\" (UID: \"8133809f-7e9a-41be-979c-034f56afb570\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:35.179256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:35.179166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:35.449049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:35.448968    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"]
Sep 11 18:18:35.452886 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:35.452857    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8133809f_7e9a_41be_979c_034f56afb570.slice/crio-f7c98446ad5d02f0130edbf38b98169af2287a615c4f221e04e8a5911729563e WatchSource:0}: Error finding container f7c98446ad5d02f0130edbf38b98169af2287a615c4f221e04e8a5911729563e: Status 404 returned error can't find the container with id f7c98446ad5d02f0130edbf38b98169af2287a615c4f221e04e8a5911729563e
Sep 11 18:18:35.504039 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:35.504002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6" event={"ID":"8133809f-7e9a-41be-979c-034f56afb570","Type":"ContainerStarted","Data":"f7c98446ad5d02f0130edbf38b98169af2287a615c4f221e04e8a5911729563e"}
Sep 11 18:18:36.508455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.508423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6" event={"ID":"8133809f-7e9a-41be-979c-034f56afb570","Type":"ContainerStarted","Data":"987b65a7573cd107fa1fdbe54a3c70b4f255955f8024e7121ae358798e566cf6"}
Sep 11 18:18:36.508841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.508632    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:36.513381 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.513361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6"
Sep 11 18:18:36.529740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.529696    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-9t8k6" podStartSLOduration=1.588417032 podStartE2EDuration="2.529681662s" totalImagesPullingTime="941.26463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:36.528615272 +0000 UTC m=+159.103718740" watchObservedRunningTime="2026-09-11 18:18:36.529681662 +0000 UTC m=+159.104785134"
Sep 11 18:18:36.896856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.896796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:36.924504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.924474    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"]
Sep 11 18:18:36.928552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.928535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:36.932556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.932536    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 18:18:36.933118 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.933094    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dg69l\""
Sep 11 18:18:36.933242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.933168    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 18:18:36.933936 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.933917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 18:18:36.945890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.945235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"]
Sep 11 18:18:36.995535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:36.995490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:37.056752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.056707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.056920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.056835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.056920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.056866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hxw\" (UniqueName: \"kubernetes.io/projected/ad167720-cf34-47af-bfb4-ff4dcbdd618f-kube-api-access-d7hxw\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.056920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.056886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad167720-cf34-47af-bfb4-ff4dcbdd618f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.157623 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.157548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.157729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.157632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.157729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.157651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hxw\" (UniqueName: \"kubernetes.io/projected/ad167720-cf34-47af-bfb4-ff4dcbdd618f-kube-api-access-d7hxw\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.157729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.157668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad167720-cf34-47af-bfb4-ff4dcbdd618f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.157729 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:37.157693    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 18:18:37.157926 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:37.157758    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-tls podName:ad167720-cf34-47af-bfb4-ff4dcbdd618f nodeName:}" failed. No retries permitted until 2026-09-11 18:18:37.657740449 +0000 UTC m=+160.232843895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-gtmqg" (UID: "ad167720-cf34-47af-bfb4-ff4dcbdd618f") : secret "prometheus-operator-tls" not found
Sep 11 18:18:37.158263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.158244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad167720-cf34-47af-bfb4-ff4dcbdd618f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.160086 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.160061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.167123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.167099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hxw\" (UniqueName: \"kubernetes.io/projected/ad167720-cf34-47af-bfb4-ff4dcbdd618f-kube-api-access-d7hxw\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.347455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.347422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:37.359454 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.359422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:37.361740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.361724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45631a58-13c6-453e-996c-478b17a551b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpvk7\" (UID: \"45631a58-13c6-453e-996c-478b17a551b7\") " pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:37.559073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.559039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpvk7"
Sep 11 18:18:37.661962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.661921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.664201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.664174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad167720-cf34-47af-bfb4-ff4dcbdd618f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gtmqg\" (UID: \"ad167720-cf34-47af-bfb4-ff4dcbdd618f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:37.830786 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.830607    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpvk7"]
Sep 11 18:18:37.833194 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:37.833169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45631a58_13c6_453e_996c_478b17a551b7.slice/crio-ddfc2c11df831f5112f3b90e1e816289e8bd34c54337a674488121c9848d4b62 WatchSource:0}: Error finding container ddfc2c11df831f5112f3b90e1e816289e8bd34c54337a674488121c9848d4b62: Status 404 returned error can't find the container with id ddfc2c11df831f5112f3b90e1e816289e8bd34c54337a674488121c9848d4b62
Sep 11 18:18:37.837689 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:37.837671    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"
Sep 11 18:18:38.114416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:38.114326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg"]
Sep 11 18:18:38.117517 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:38.117484    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad167720_cf34_47af_bfb4_ff4dcbdd618f.slice/crio-40edb702a99b696e456d15f0ab4a4c9df3dabee11b2eb5c3bc94789f2e7a05a1 WatchSource:0}: Error finding container 40edb702a99b696e456d15f0ab4a4c9df3dabee11b2eb5c3bc94789f2e7a05a1: Status 404 returned error can't find the container with id 40edb702a99b696e456d15f0ab4a4c9df3dabee11b2eb5c3bc94789f2e7a05a1
Sep 11 18:18:38.515482 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:38.515454    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpvk7" event={"ID":"45631a58-13c6-453e-996c-478b17a551b7","Type":"ContainerStarted","Data":"fb99faa49cc031c0a30e60a215a62a8832ceb56de6cf8181c091370646000594"}
Sep 11 18:18:38.515601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:38.515524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpvk7" event={"ID":"45631a58-13c6-453e-996c-478b17a551b7","Type":"ContainerStarted","Data":"ddfc2c11df831f5112f3b90e1e816289e8bd34c54337a674488121c9848d4b62"}
Sep 11 18:18:38.516475 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:38.516450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg" event={"ID":"ad167720-cf34-47af-bfb4-ff4dcbdd618f","Type":"ContainerStarted","Data":"40edb702a99b696e456d15f0ab4a4c9df3dabee11b2eb5c3bc94789f2e7a05a1"}
Sep 11 18:18:38.772177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:38.772143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:18:38.774601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:38.774567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dabbd38b-95eb-48b5-b74c-a87f82e02ac7-metrics-tls\") pod \"dns-default-mxg7k\" (UID: \"dabbd38b-95eb-48b5-b74c-a87f82e02ac7\") " pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:18:39.004063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.004028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bf6d6\""
Sep 11 18:18:39.012130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.012100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:18:39.488072 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.487909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxg7k"]
Sep 11 18:18:39.495054 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:39.493423    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabbd38b_95eb_48b5_b74c_a87f82e02ac7.slice/crio-ec55fdaee91be4f35572646437b94ac01dc7f1ba6bcadce881cb54d376b6b4ed WatchSource:0}: Error finding container ec55fdaee91be4f35572646437b94ac01dc7f1ba6bcadce881cb54d376b6b4ed: Status 404 returned error can't find the container with id ec55fdaee91be4f35572646437b94ac01dc7f1ba6bcadce881cb54d376b6b4ed
Sep 11 18:18:39.527360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.527294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpvk7" event={"ID":"45631a58-13c6-453e-996c-478b17a551b7","Type":"ContainerStarted","Data":"654dc6ff4250950ca2e241dd46baac1726097a1ea6d236a31a8c0ae9573f75d3"}
Sep 11 18:18:39.530738 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.530700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg" event={"ID":"ad167720-cf34-47af-bfb4-ff4dcbdd618f","Type":"ContainerStarted","Data":"1225983ceb060c7dda6026a52d363d26b3777f0b2e1148a09c4bcfc76388c61d"}
Sep 11 18:18:39.530884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.530758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg" event={"ID":"ad167720-cf34-47af-bfb4-ff4dcbdd618f","Type":"ContainerStarted","Data":"5ac3817e496a39198f96272ddc2dfe108826b42cbda60c78abc654b5ed2c43fe"}
Sep 11 18:18:39.532570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.532540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxg7k" event={"ID":"dabbd38b-95eb-48b5-b74c-a87f82e02ac7","Type":"ContainerStarted","Data":"ec55fdaee91be4f35572646437b94ac01dc7f1ba6bcadce881cb54d376b6b4ed"}
Sep 11 18:18:39.554938 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.554885    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gtmqg" podStartSLOduration=2.409276434 podStartE2EDuration="3.554868988s" totalImagesPullingTime="1.145592554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:39.553322318 +0000 UTC m=+162.128425788" watchObservedRunningTime="2026-09-11 18:18:39.554868988 +0000 UTC m=+162.129972453"
Sep 11 18:18:39.558539 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:39.558466    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:40.539024 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:40.538984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpvk7" event={"ID":"45631a58-13c6-453e-996c-478b17a551b7","Type":"ContainerStarted","Data":"e0ba98e3815c304afdcc5bede20e6b28ad8f58e02debee9c14b20d4b621e4dc1"}
Sep 11 18:18:40.561670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:40.561398    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kpvk7" podStartSLOduration=33.318768991 podStartE2EDuration="35.561379928s" totalImagesPullingTime="2.242610937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:18:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:40.56136528 +0000 UTC m=+163.136468749" watchObservedRunningTime="2026-09-11 18:18:40.561379928 +0000 UTC m=+163.136483397"
Sep 11 18:18:41.058238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.058197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.226895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.226841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.320067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.319991    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"]
Sep 11 18:18:41.323663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.323564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.326870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.326848    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j6b7c\""
Sep 11 18:18:41.327319 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.327292    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 18:18:41.327476 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.327460    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 18:18:41.340507 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.340486    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"]
Sep 11 18:18:41.351930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.351910    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"]
Sep 11 18:18:41.356372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.356352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.358283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.358247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.359641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.359091    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 18:18:41.359641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.359370    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 18:18:41.359641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.359581    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 18:18:41.359840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.359737    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5q2rs\""
Sep 11 18:18:41.368382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.368331    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gdpbp"]
Sep 11 18:18:41.371870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.371849    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"]
Sep 11 18:18:41.372003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.371987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.374810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.374787    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 18:18:41.374903 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.374876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 18:18:41.375956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.375566    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-962fk\""
Sep 11 18:18:41.375956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.375783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 18:18:41.395278 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.395253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08154855-b609-41d7-81cd-c353afd8518c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.395386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.395291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08154855-b609-41d7-81cd-c353afd8518c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.395386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.395357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08154855-b609-41d7-81cd-c353afd8518c-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.395468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.395407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvqzc\" (UniqueName: \"kubernetes.io/projected/08154855-b609-41d7-81cd-c353afd8518c-kube-api-access-wvqzc\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.451430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.451291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.496083 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-sys\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbmmp\" (UniqueName: \"kubernetes.io/projected/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-api-access-dbmmp\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.496206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-metrics-client-ca\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvqzc\" (UniqueName: \"kubernetes.io/projected/08154855-b609-41d7-81cd-c353afd8518c-kube-api-access-wvqzc\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.496206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08154855-b609-41d7-81cd-c353afd8518c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.496206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-tls\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-wtmp\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-root\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08154855-b609-41d7-81cd-c353afd8518c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-accelerators-collector-config\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf58j\" (UniqueName: \"kubernetes.io/projected/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-kube-api-access-sf58j\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.496460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.496748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a251c79f-a1f8-4736-8371-37b8f67d8552-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.496748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-textfile\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.496748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a251c79f-a1f8-4736-8371-37b8f67d8552-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.496748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08154855-b609-41d7-81cd-c353afd8518c-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.496748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.496706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.497396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.497375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08154855-b609-41d7-81cd-c353afd8518c-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.498449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.498431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08154855-b609-41d7-81cd-c353afd8518c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.498523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.498487    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08154855-b609-41d7-81cd-c353afd8518c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.506350 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.506332    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvqzc\" (UniqueName: \"kubernetes.io/projected/08154855-b609-41d7-81cd-c353afd8518c-kube-api-access-wvqzc\") pod \"openshift-state-metrics-67dcf8c979-62l5j\" (UID: \"08154855-b609-41d7-81cd-c353afd8518c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.543957 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.543914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxg7k" event={"ID":"dabbd38b-95eb-48b5-b74c-a87f82e02ac7","Type":"ContainerStarted","Data":"d71aeec5979153fc30f790da9e395ba748b56f0647ced3f6c43a47a63ba02def"}
Sep 11 18:18:41.544386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.543977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxg7k" event={"ID":"dabbd38b-95eb-48b5-b74c-a87f82e02ac7","Type":"ContainerStarted","Data":"572f178a9545a340f115a55513b0e7588925bc6724ee0be43be91296ae101dcc"}
Sep 11 18:18:41.544386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.544172    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:18:41.569391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.569362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.583864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.583750    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mxg7k" podStartSLOduration=129.754935395 podStartE2EDuration="2m11.583731065s" totalImagesPullingTime="1.82879567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:41.583458231 +0000 UTC m=+164.158561711" watchObservedRunningTime="2026-09-11 18:18:41.583731065 +0000 UTC m=+164.158834535"
Sep 11 18:18:41.597721 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbmmp\" (UniqueName: \"kubernetes.io/projected/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-api-access-dbmmp\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.597812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-metrics-client-ca\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.597812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-tls\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.597812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-wtmp\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.597812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-root\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-accelerators-collector-config\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf58j\" (UniqueName: \"kubernetes.io/projected/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-kube-api-access-sf58j\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-root\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-wtmp\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.597963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.598028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a251c79f-a1f8-4736-8371-37b8f67d8552-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-textfile\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a251c79f-a1f8-4736-8371-37b8f67d8552-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-sys\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-sys\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598408    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-metrics-client-ca\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-accelerators-collector-config\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598657    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-textfile\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.598869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.598817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a251c79f-a1f8-4736-8371-37b8f67d8552-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.599235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.599206    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a251c79f-a1f8-4736-8371-37b8f67d8552-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.599563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.599540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.600529 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.600510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-tls\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.600688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.600672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.600752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.600704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.600962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.600944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.607102 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.607081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbmmp\" (UniqueName: \"kubernetes.io/projected/a251c79f-a1f8-4736-8371-37b8f67d8552-kube-api-access-dbmmp\") pod \"kube-state-metrics-59fbdd77d-mmmk2\" (UID: \"a251c79f-a1f8-4736-8371-37b8f67d8552\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.607441 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.607425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf58j\" (UniqueName: \"kubernetes.io/projected/d46df4b9-939c-4fcc-92e5-5d1e5a22c60c-kube-api-access-sf58j\") pod \"node-exporter-gdpbp\" (UID: \"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c\") " pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.632347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.632326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"
Sep 11 18:18:41.668719 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.668688    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"
Sep 11 18:18:41.683730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.683327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gdpbp"
Sep 11 18:18:41.689190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.688970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.696837 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:41.696802    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46df4b9_939c_4fcc_92e5_5d1e5a22c60c.slice/crio-29b3b4e1da4ba23aa5a78d5f3d4662825a53b8403a83326d6ae58a3ea5bd8701 WatchSource:0}: Error finding container 29b3b4e1da4ba23aa5a78d5f3d4662825a53b8403a83326d6ae58a3ea5bd8701: Status 404 returned error can't find the container with id 29b3b4e1da4ba23aa5a78d5f3d4662825a53b8403a83326d6ae58a3ea5bd8701
Sep 11 18:18:41.789060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.789028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:41.914693 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.910720    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j"]
Sep 11 18:18:41.956781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:41.956750    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2"]
Sep 11 18:18:41.959590 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:41.959559    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda251c79f_a1f8_4736_8371_37b8f67d8552.slice/crio-2d7a3c4b54486c06193a537b3d870b69ea027b9bcbf499e59c65a47b57fcdaec WatchSource:0}: Error finding container 2d7a3c4b54486c06193a537b3d870b69ea027b9bcbf499e59c65a47b57fcdaec: Status 404 returned error can't find the container with id 2d7a3c4b54486c06193a537b3d870b69ea027b9bcbf499e59c65a47b57fcdaec
Sep 11 18:18:42.108134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.108099    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:42.297903 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.297857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:42.396969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.396931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:42.406653 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.406623    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:18:42.414201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.414105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.416864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.416843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 18:18:42.417193 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.417171    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 18:18:42.417588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.417571    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mc42v\""
Sep 11 18:18:42.418043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.417753    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 18:18:42.418043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.417883    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 18:18:42.418043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.417929    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 18:18:42.418043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.417942    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 18:18:42.418288 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.418188    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 18:18:42.418462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.418426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 18:18:42.421242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.421218    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 18:18:42.432025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.431917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:18:42.515087 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.514996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:42.520007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.519976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520152 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzvq\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-kube-api-access-8tzvq\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520152 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-web-config\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520152 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520486    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-out\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.520628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.520503    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.551636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.551562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j" event={"ID":"08154855-b609-41d7-81cd-c353afd8518c","Type":"ContainerStarted","Data":"7c9a25a90b365174b1eb91b5bb3740a276539241157ddf513fcd6fdf660c4395"}
Sep 11 18:18:42.552015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.551636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j" event={"ID":"08154855-b609-41d7-81cd-c353afd8518c","Type":"ContainerStarted","Data":"74b3b570e8edf85967edced0a119d4e8c4268a39f5b7082cebe26c3d8fe740b2"}
Sep 11 18:18:42.552015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.551666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j" event={"ID":"08154855-b609-41d7-81cd-c353afd8518c","Type":"ContainerStarted","Data":"e2d46d13a12605041f3870cba1e238074880b36d16410b8ffdf9e1b9b40e6027"}
Sep 11 18:18:42.553172 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.553113    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpbp" event={"ID":"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c","Type":"ContainerStarted","Data":"29b3b4e1da4ba23aa5a78d5f3d4662825a53b8403a83326d6ae58a3ea5bd8701"}
Sep 11 18:18:42.554694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.554669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2" event={"ID":"a251c79f-a1f8-4736-8371-37b8f67d8552","Type":"ContainerStarted","Data":"2d7a3c4b54486c06193a537b3d870b69ea027b9bcbf499e59c65a47b57fcdaec"}
Sep 11 18:18:42.621369 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-out\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzvq\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-kube-api-access-8tzvq\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-web-config\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.621981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.621807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.622203 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:18:42.622177    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle podName:ae4e54a1-4c3f-4d89-a8f8-0e625abdf453 nodeName:}" failed. No retries permitted until 2026-09-11 18:18:43.122154534 +0000 UTC m=+165.697257986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453") : configmap references non-existent config key: ca-bundle.crt
Sep 11 18:18:42.624612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.623268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.624612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.623785    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.628166 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.628120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.628931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.628891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.631296 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.631233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.631841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.631524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.631841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.631806    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-web-config\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.632111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.632090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-out\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.632800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.632761    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.633135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.633112    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.633403 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.633380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzvq\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-kube-api-access-8tzvq\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:42.634757 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:42.634715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:43.126667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.126631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:43.127411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.127385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:43.327467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.327428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:18:43.566806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.566759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2" event={"ID":"a251c79f-a1f8-4736-8371-37b8f67d8552","Type":"ContainerStarted","Data":"2e079c3d8c7b64c92a5611dcbca7afb7d8534ffcd886fc2cace1847ab56589d1"}
Sep 11 18:18:43.567201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.566839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2" event={"ID":"a251c79f-a1f8-4736-8371-37b8f67d8552","Type":"ContainerStarted","Data":"b183afd6fe49a0f7ece04991841aa7ed37bedcbd1633f38279bd7e04824413b9"}
Sep 11 18:18:43.571498 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.571455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j" event={"ID":"08154855-b609-41d7-81cd-c353afd8518c","Type":"ContainerStarted","Data":"aa6f857d13aa1cc8f8077ed47ccb277a1347ebc0ff6f8b2173924298d5d873cc"}
Sep 11 18:18:43.575354 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.575188    2561 generic.go:356] "Generic (PLEG): container finished" podID="d46df4b9-939c-4fcc-92e5-5d1e5a22c60c" containerID="840350f4f7a5cc59dcefc02fcae1deb85d1f6464f7a236bc0acf6a0768cc78b7" exitCode=0
Sep 11 18:18:43.575354 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.575282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpbp" event={"ID":"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c","Type":"ContainerDied","Data":"840350f4f7a5cc59dcefc02fcae1deb85d1f6464f7a236bc0acf6a0768cc78b7"}
Sep 11 18:18:43.595467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.595417    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-62l5j" podStartSLOduration=1.263939326 podStartE2EDuration="2.595398655s" totalImagesPullingTime="1.331459329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:43.594561857 +0000 UTC m=+166.169665325" watchObservedRunningTime="2026-09-11 18:18:43.595398655 +0000 UTC m=+166.170502127"
Sep 11 18:18:43.672445 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:43.672420    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:18:43.675031 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:43.675006    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4e54a1_4c3f_4d89_a8f8_0e625abdf453.slice/crio-b750a6564cc1db35eb164bac5c6ca6b7cd9f14f943cb9564a6fcf77d912703a1 WatchSource:0}: Error finding container b750a6564cc1db35eb164bac5c6ca6b7cd9f14f943cb9564a6fcf77d912703a1: Status 404 returned error can't find the container with id b750a6564cc1db35eb164bac5c6ca6b7cd9f14f943cb9564a6fcf77d912703a1
Sep 11 18:18:44.375788 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.375752    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:44.448787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.448747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:44.582944 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.582903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpbp" event={"ID":"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c","Type":"ContainerStarted","Data":"d89815fa7512614da68ea308e4c0b882a3617681dcfd24ea0551003acad68ea1"}
Sep 11 18:18:44.583433 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.582972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gdpbp" event={"ID":"d46df4b9-939c-4fcc-92e5-5d1e5a22c60c","Type":"ContainerStarted","Data":"cbfcf707904c204e123c5ce6232d2dccc733911d6e37a09f8592d7563fc04e0a"}
Sep 11 18:18:44.584495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.584458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"b750a6564cc1db35eb164bac5c6ca6b7cd9f14f943cb9564a6fcf77d912703a1"}
Sep 11 18:18:44.586922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.586894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2" event={"ID":"a251c79f-a1f8-4736-8371-37b8f67d8552","Type":"ContainerStarted","Data":"bc74f9ca483ef947bc4d71e0fcb45ae1ad43f326b944e98dd1b58191b0946b10"}
Sep 11 18:18:44.607825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.607777    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gdpbp" podStartSLOduration=2.487095419 podStartE2EDuration="3.607762331s" totalImagesPullingTime="1.035621538s" totalInitContainerRuntime="85.045374ms" isStatefulPod=true podCreationTimestamp="2026-09-11 18:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:44.606353334 +0000 UTC m=+167.181456804" watchObservedRunningTime="2026-09-11 18:18:44.607762331 +0000 UTC m=+167.182865800"
Sep 11 18:18:44.624466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.624417    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mmmk2" podStartSLOduration=2.2047131 podStartE2EDuration="3.624397574s" totalImagesPullingTime="1.419684474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:44.623664639 +0000 UTC m=+167.198768098" watchObservedRunningTime="2026-09-11 18:18:44.624397574 +0000 UTC m=+167.199501043"
Sep 11 18:18:44.716675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.716648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:44.897380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:44.897344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:45.593721 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:45.593690    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="f401b5f631826e57ac45f87af23769aa0f0a947ac6f1e483e131570c2b088379" exitCode=0
Sep 11 18:18:45.594068 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:45.593786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"f401b5f631826e57ac45f87af23769aa0f0a947ac6f1e483e131570c2b088379"}
Sep 11 18:18:46.075361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.075323    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"]
Sep 11 18:18:46.078554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.078534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.081114 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.081090    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jnj9x\""
Sep 11 18:18:46.081488 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.081470    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 18:18:46.088499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.088469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:46.089545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.089523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"]
Sep 11 18:18:46.158083 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.158046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nxfl\" (UniqueName: \"kubernetes.io/projected/a4c52d08-1846-47bc-a459-439362ead21c-kube-api-access-6nxfl\") pod \"monitoring-plugin-5d85778b9d-5n5wn\" (UID: \"a4c52d08-1846-47bc-a459-439362ead21c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.158251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.158169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4c52d08-1846-47bc-a459-439362ead21c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-5n5wn\" (UID: \"a4c52d08-1846-47bc-a459-439362ead21c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.241290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.241241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:46.259122 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.259087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nxfl\" (UniqueName: \"kubernetes.io/projected/a4c52d08-1846-47bc-a459-439362ead21c-kube-api-access-6nxfl\") pod \"monitoring-plugin-5d85778b9d-5n5wn\" (UID: \"a4c52d08-1846-47bc-a459-439362ead21c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.259292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.259150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4c52d08-1846-47bc-a459-439362ead21c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-5n5wn\" (UID: \"a4c52d08-1846-47bc-a459-439362ead21c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.262088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.262064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4c52d08-1846-47bc-a459-439362ead21c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-5n5wn\" (UID: \"a4c52d08-1846-47bc-a459-439362ead21c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.268192 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.268165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nxfl\" (UniqueName: \"kubernetes.io/projected/a4c52d08-1846-47bc-a459-439362ead21c-kube-api-access-6nxfl\") pod \"monitoring-plugin-5d85778b9d-5n5wn\" (UID: \"a4c52d08-1846-47bc-a459-439362ead21c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.391739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.391659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:46.592850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.592807    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"]
Sep 11 18:18:46.601467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.601434    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.603714 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.603696    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 18:18:46.605572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.605552    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 18:18:46.605754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.605732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rjwr6\""
Sep 11 18:18:46.605955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.605933    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 18:18:46.607479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.606494    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 18:18:46.608086 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.608072    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 18:18:46.612278 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.612242    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 18:18:46.615135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.615115    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"]
Sep 11 18:18:46.675059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.674991    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"]
Sep 11 18:18:46.764848 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.764802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.764854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-federate-client-tls\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.764919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-metrics-client-ca\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765119 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.765004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-serving-certs-ca-bundle\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765119 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.765083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-telemeter-client-tls\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.765136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.765166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwk99\" (UniqueName: \"kubernetes.io/projected/711c62d1-4585-4e20-8624-78f8b0adc1da-kube-api-access-zwk99\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.765206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.765198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-secret-telemeter-client\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwk99\" (UniqueName: \"kubernetes.io/projected/711c62d1-4585-4e20-8624-78f8b0adc1da-kube-api-access-zwk99\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-secret-telemeter-client\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-federate-client-tls\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-metrics-client-ca\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-serving-certs-ca-bundle\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.866481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.866456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-telemeter-client-tls\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.867197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.867164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.867197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.867179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-metrics-client-ca\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.867473 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.867175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711c62d1-4585-4e20-8624-78f8b0adc1da-serving-certs-ca-bundle\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.869212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.869189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.869523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.869502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-telemeter-client-tls\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.869991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.869970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-secret-telemeter-client\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.870101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.870076    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/711c62d1-4585-4e20-8624-78f8b0adc1da-federate-client-tls\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.875928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.875898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwk99\" (UniqueName: \"kubernetes.io/projected/711c62d1-4585-4e20-8624-78f8b0adc1da-kube-api-access-zwk99\") pod \"telemeter-client-6fc75994d4-jwjcr\" (UID: \"711c62d1-4585-4e20-8624-78f8b0adc1da\") " pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.918997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:46.918969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"
Sep 11 18:18:46.930110 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:46.930050    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c52d08_1846_47bc_a459_439362ead21c.slice/crio-f3444d30189c3cf68e88a3d84e8eeee440fd17dd945f777b691342dafb3da14e WatchSource:0}: Error finding container f3444d30189c3cf68e88a3d84e8eeee440fd17dd945f777b691342dafb3da14e: Status 404 returned error can't find the container with id f3444d30189c3cf68e88a3d84e8eeee440fd17dd945f777b691342dafb3da14e
Sep 11 18:18:47.209885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.209860    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fc75994d4-jwjcr"]
Sep 11 18:18:47.212020 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:47.211995    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711c62d1_4585_4e20_8624_78f8b0adc1da.slice/crio-e52c4ad1d3b6d09cc3205124c435d31bca6d14f28a2950818cf6b6fe7b45b74c WatchSource:0}: Error finding container e52c4ad1d3b6d09cc3205124c435d31bca6d14f28a2950818cf6b6fe7b45b74c: Status 404 returned error can't find the container with id e52c4ad1d3b6d09cc3205124c435d31bca6d14f28a2950818cf6b6fe7b45b74c
Sep 11 18:18:47.611661 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.611619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn" event={"ID":"a4c52d08-1846-47bc-a459-439362ead21c","Type":"ContainerStarted","Data":"f3444d30189c3cf68e88a3d84e8eeee440fd17dd945f777b691342dafb3da14e"}
Sep 11 18:18:47.615823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.615787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"7e1326db0061d98ced8383f817190057220fbbd10b1f27b9f418a68f02488630"}
Sep 11 18:18:47.615964 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.615890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"ec42d7d6ef7a88355e79639066ca7c5c7578723fa728f9899e7eeefe1f59e578"}
Sep 11 18:18:47.615964 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.615936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"281875e3da1f06115a18b3a5910c977eca6d5f8cf2835e5c7c1adcf3a4244a44"}
Sep 11 18:18:47.616074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.615976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"a835b6b738aadb043edc8b1ad684ba6c70adb092fdc5ddd3068c787ddb197ad0"}
Sep 11 18:18:47.616074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.616016    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"48bef8d4e6519c8576b1918827626561379aebfcd343eabc219bb9734a8bc54a"}
Sep 11 18:18:47.617089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.617061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr" event={"ID":"711c62d1-4585-4e20-8624-78f8b0adc1da","Type":"ContainerStarted","Data":"e52c4ad1d3b6d09cc3205124c435d31bca6d14f28a2950818cf6b6fe7b45b74c"}
Sep 11 18:18:47.694969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.694812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:47.904418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:47.904336    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:18:48.049144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.049103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:48.149991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.149955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:48.623695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.623652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn" event={"ID":"a4c52d08-1846-47bc-a459-439362ead21c","Type":"ContainerStarted","Data":"015d6f2ae0d46ec1fe35f4ec0fd481ff0746714fcb89f55e7511afb2261fadc2"}
Sep 11 18:18:48.624134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.623761    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:48.631222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.631195    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn"
Sep 11 18:18:48.631397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.631252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerStarted","Data":"dccabbdc305630fc2059fdc618da107e3132a55faf970da271b4d58051fefe97"}
Sep 11 18:18:48.642844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.642797    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-5n5wn" podStartSLOduration=1.092539194 podStartE2EDuration="2.642781656s" totalImagesPullingTime="1.550242462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:48.641297611 +0000 UTC m=+171.216401080" watchObservedRunningTime="2026-09-11 18:18:48.642781656 +0000 UTC m=+171.217885123"
Sep 11 18:18:48.687242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:48.687179    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.14341396 podStartE2EDuration="6.687155601s" totalImagesPullingTime="3.527556539s" totalInitContainerRuntime="16.185102ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:48.685210425 +0000 UTC m=+171.260313896" watchObservedRunningTime="2026-09-11 18:18:48.687155601 +0000 UTC m=+171.262259070"
Sep 11 18:18:49.638073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:49.638033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr" event={"ID":"711c62d1-4585-4e20-8624-78f8b0adc1da","Type":"ContainerStarted","Data":"f31758fadcd41992a8cd0c57cf2a801fb846aa19cd91b9ab1db60bccaa93dd1a"}
Sep 11 18:18:49.638443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:49.638099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr" event={"ID":"711c62d1-4585-4e20-8624-78f8b0adc1da","Type":"ContainerStarted","Data":"3f2a552d165b80437473e9e6c5d0ef0e7873afc7aa08efd93997f3d6062ac4a5"}
Sep 11 18:18:49.638443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:49.638119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr" event={"ID":"711c62d1-4585-4e20-8624-78f8b0adc1da","Type":"ContainerStarted","Data":"327496b14ceddf72d485e063e430dcdeb0ff6b8f6953614db4ebb5c5db94cfa1"}
Sep 11 18:18:49.665438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:49.665389    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fc75994d4-jwjcr" podStartSLOduration=1.857523215 podStartE2EDuration="3.665374981s" totalImagesPullingTime="1.807851766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:18:49.663966048 +0000 UTC m=+172.239069527" watchObservedRunningTime="2026-09-11 18:18:49.665374981 +0000 UTC m=+172.240478448"
Sep 11 18:18:51.556945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:51.556874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mxg7k"
Sep 11 18:18:52.495718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:52.495687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764fdbb777-b6xj5"
Sep 11 18:18:52.654094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:52.654055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:52.761895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:52.761796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:52.862627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:52.862593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:55.505862 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.505826    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-c46db"]
Sep 11 18:18:55.509535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.509504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:18:55.512161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.512140    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-f8kv5\""
Sep 11 18:18:55.512269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.512161    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 18:18:55.512269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.512187    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 18:18:55.521951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.521924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-c46db"]
Sep 11 18:18:55.533098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.533067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:55.604338 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.604276    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:55.639326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.639279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbf4b\" (UniqueName: \"kubernetes.io/projected/d14c9b87-4f1c-454b-b9ba-f672d7fde88f-kube-api-access-vbf4b\") pod \"downloads-76f99584f4-c46db\" (UID: \"d14c9b87-4f1c-454b-b9ba-f672d7fde88f\") " pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:18:55.672375 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.672340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:55.740623 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.740586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbf4b\" (UniqueName: \"kubernetes.io/projected/d14c9b87-4f1c-454b-b9ba-f672d7fde88f-kube-api-access-vbf4b\") pod \"downloads-76f99584f4-c46db\" (UID: \"d14c9b87-4f1c-454b-b9ba-f672d7fde88f\") " pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:18:55.755318 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.755268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbf4b\" (UniqueName: \"kubernetes.io/projected/d14c9b87-4f1c-454b-b9ba-f672d7fde88f-kube-api-access-vbf4b\") pod \"downloads-76f99584f4-c46db\" (UID: \"d14c9b87-4f1c-454b-b9ba-f672d7fde88f\") " pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:18:55.811322 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.811211    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:55.821077 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.821047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:18:55.980586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:55.980542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:56.118588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:56.118518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-c46db"]
Sep 11 18:18:56.122482 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:18:56.122457    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14c9b87_4f1c_454b_b9ba_f672d7fde88f.slice/crio-a627e55a5de8a97b73f4471871c1e441a14c07837680028f450b7aecee634619 WatchSource:0}: Error finding container a627e55a5de8a97b73f4471871c1e441a14c07837680028f450b7aecee634619: Status 404 returned error can't find the container with id a627e55a5de8a97b73f4471871c1e441a14c07837680028f450b7aecee634619
Sep 11 18:18:56.198804 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:56.198768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:56.276682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:56.276640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:56.586397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:56.586359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:56.669554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:56.669508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-c46db" event={"ID":"d14c9b87-4f1c-454b-b9ba-f672d7fde88f","Type":"ContainerStarted","Data":"a627e55a5de8a97b73f4471871c1e441a14c07837680028f450b7aecee634619"}
Sep 11 18:18:56.979909 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:56.979828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:57.048970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:57.048936    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:57.189573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:57.189527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:57.390648 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:57.390610    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:57.805227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:57.805194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:58.803870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:58.803829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:18:58.869257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:18:58.869221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:00.691768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:00.691715    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:00.793081 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:00.793041    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:01.750897 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:01.750860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:01.894675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:01.894629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:03.144388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:03.144348    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:03.216669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:03.216631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:04.770883 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:04.770832    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:04.866596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:04.866558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:06.957652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.957619    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5869bd7989-6fjtl"]
Sep 11 18:19:06.962371 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.962347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:06.965091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.965059    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 18:19:06.965252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.965132    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x8d66\""
Sep 11 18:19:06.965252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.965140    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 18:19:06.966021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.966001    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 18:19:06.966111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.966007    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 18:19:06.966111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.966032    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 18:19:06.971021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:06.970841    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5869bd7989-6fjtl"]
Sep 11 18:19:07.045991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.045950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-config\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.046167 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.046007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkrzw\" (UniqueName: \"kubernetes.io/projected/0223d276-6e1d-4a79-9bbe-52b19657fc0c-kube-api-access-kkrzw\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.046167 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.046075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-service-ca\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.046242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.046190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-serving-cert\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.046242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.046218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-oauth-serving-cert\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.046368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.046261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-oauth-config\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-config\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkrzw\" (UniqueName: \"kubernetes.io/projected/0223d276-6e1d-4a79-9bbe-52b19657fc0c-kube-api-access-kkrzw\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-service-ca\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-serving-cert\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-oauth-serving-cert\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-oauth-config\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.147953 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-config\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.148084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.147976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-service-ca\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.148084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.148064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-oauth-serving-cert\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.150096 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.150075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-serving-cert\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.150191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.150158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-oauth-config\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.156822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.156799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkrzw\" (UniqueName: \"kubernetes.io/projected/0223d276-6e1d-4a79-9bbe-52b19657fc0c-kube-api-access-kkrzw\") pod \"console-5869bd7989-6fjtl\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") " pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.274842 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.274800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:07.420802 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.420745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:07.522025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:07.521982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:10.235862 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:10.235819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:10.298762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:10.298714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:10.880175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:10.880130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:10.983056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:10.983020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:11.978056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:11.978028    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/init-config-reloader/0.log"
Sep 11 18:19:12.188121 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.188091    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/alertmanager/0.log"
Sep 11 18:19:12.218645 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.218570    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5869bd7989-6fjtl"]
Sep 11 18:19:12.222183 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:19:12.222151    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0223d276_6e1d_4a79_9bbe_52b19657fc0c.slice/crio-bfcb998a781a93d0d1ed229f5ea080be217b6c7e442a83b7cf1e73ad233b8160 WatchSource:0}: Error finding container bfcb998a781a93d0d1ed229f5ea080be217b6c7e442a83b7cf1e73ad233b8160: Status 404 returned error can't find the container with id bfcb998a781a93d0d1ed229f5ea080be217b6c7e442a83b7cf1e73ad233b8160
Sep 11 18:19:12.377318 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.377259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/config-reloader/0.log"
Sep 11 18:19:12.420053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.420014    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:12.523756 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.523724    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:12.578710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.578683    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/kube-rbac-proxy-web/0.log"
Sep 11 18:19:12.748110 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.748065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5869bd7989-6fjtl" event={"ID":"0223d276-6e1d-4a79-9bbe-52b19657fc0c","Type":"ContainerStarted","Data":"bfcb998a781a93d0d1ed229f5ea080be217b6c7e442a83b7cf1e73ad233b8160"}
Sep 11 18:19:12.750031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.749998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-c46db" event={"ID":"d14c9b87-4f1c-454b-b9ba-f672d7fde88f","Type":"ContainerStarted","Data":"c08c6fa754b6a75beaeb2eb33bb064fb766471386c31b40078190cb496b41683"}
Sep 11 18:19:12.750248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.750223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:19:12.772484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.772423    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-c46db" podStartSLOduration=1.8803664100000002 podStartE2EDuration="17.772401751s" totalImagesPullingTime="15.892035341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:19:12.770829426 +0000 UTC m=+195.345932904" watchObservedRunningTime="2026-09-11 18:19:12.772401751 +0000 UTC m=+195.347505227"
Sep 11 18:19:12.773519 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.773493    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-c46db"
Sep 11 18:19:12.780468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.780403    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/kube-rbac-proxy/0.log"
Sep 11 18:19:12.978084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:12.978051    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/kube-rbac-proxy-metric/0.log"
Sep 11 18:19:13.179226 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:13.179114    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/prom-label-proxy/0.log"
Sep 11 18:19:13.383077 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:13.382986    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-7d9zn_516c07df-f9a7-48a7-8cd4-b992f37bfb44/cluster-monitoring-operator/0.log"
Sep 11 18:19:13.579913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:13.579810    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mmmk2_a251c79f-a1f8-4736-8371-37b8f67d8552/kube-state-metrics/0.log"
Sep 11 18:19:13.780020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:13.779981    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mmmk2_a251c79f-a1f8-4736-8371-37b8f67d8552/kube-rbac-proxy-main/0.log"
Sep 11 18:19:13.977365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:13.977264    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mmmk2_a251c79f-a1f8-4736-8371-37b8f67d8552/kube-rbac-proxy-self/0.log"
Sep 11 18:19:14.164524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:14.164485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:14.347010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:14.346968    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:14.382382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:14.382341    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-5n5wn_a4c52d08-1846-47bc-a459-439362ead21c/monitoring-plugin/0.log"
Sep 11 18:19:14.445045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:14.445009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:15.178093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:15.178036    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpbp_d46df4b9-939c-4fcc-92e5-5d1e5a22c60c/init-textfile/0.log"
Sep 11 18:19:15.380566 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:15.380431    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpbp_d46df4b9-939c-4fcc-92e5-5d1e5a22c60c/node-exporter/0.log"
Sep 11 18:19:15.577792 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:15.577754    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpbp_d46df4b9-939c-4fcc-92e5-5d1e5a22c60c/kube-rbac-proxy/0.log"
Sep 11 18:19:16.377898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:16.377846    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-62l5j_08154855-b609-41d7-81cd-c353afd8518c/kube-rbac-proxy-main/0.log"
Sep 11 18:19:16.580615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:16.580578    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-62l5j_08154855-b609-41d7-81cd-c353afd8518c/kube-rbac-proxy-self/0.log"
Sep 11 18:19:16.771611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:16.771571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5869bd7989-6fjtl" event={"ID":"0223d276-6e1d-4a79-9bbe-52b19657fc0c","Type":"ContainerStarted","Data":"ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4"}
Sep 11 18:19:16.777801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:16.777773    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-62l5j_08154855-b609-41d7-81cd-c353afd8518c/openshift-state-metrics/0.log"
Sep 11 18:19:16.791155 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:16.791104    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5869bd7989-6fjtl" podStartSLOduration=6.809127523 podStartE2EDuration="10.79108286s" totalImagesPullingTime="3.981955337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:19:16.788743237 +0000 UTC m=+199.363846707" watchObservedRunningTime="2026-09-11 18:19:16.79108286 +0000 UTC m=+199.366186329"
Sep 11 18:19:17.056150 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.056111    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:17.163654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.163605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:17.233877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.233839    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5f885666-ztbfd"]
Sep 11 18:19:17.261678 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.261644    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5f885666-ztbfd"]
Sep 11 18:19:17.261857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.261780    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.272077 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.272045    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 18:19:17.275876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.275851    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:17.275980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.275903    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:17.281115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.281094    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:17.351130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-oauth-serving-cert\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.351130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-serving-cert\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.351130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-service-ca\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.351409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-oauth-config\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.351409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-trusted-ca-bundle\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.351409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-config\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.351409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.351385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npl79\" (UniqueName: \"kubernetes.io/projected/d3ea45b5-375f-4859-8ea6-bd5fed793657-kube-api-access-npl79\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452086 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-config\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npl79\" (UniqueName: \"kubernetes.io/projected/d3ea45b5-375f-4859-8ea6-bd5fed793657-kube-api-access-npl79\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-oauth-serving-cert\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-serving-cert\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-service-ca\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-oauth-config\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-trusted-ca-bundle\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.452955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.452927    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-config\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.453279 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.453257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-service-ca\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.453676 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.453652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-trusted-ca-bundle\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.453850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.453826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-oauth-serving-cert\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.455292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.455265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-serving-cert\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.455492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.455474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-oauth-config\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.461176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.461152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npl79\" (UniqueName: \"kubernetes.io/projected/d3ea45b5-375f-4859-8ea6-bd5fed793657-kube-api-access-npl79\") pod \"console-5f5f885666-ztbfd\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") " pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.573098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.573060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:17.781160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.781127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:17.874411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:17.874336    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5f885666-ztbfd"]
Sep 11 18:19:17.880789 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:19:17.880757    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ea45b5_375f_4859_8ea6_bd5fed793657.slice/crio-3f045d9d298b28271d36d243e801d3939c4aa743ca14029e3635f1a278901a62 WatchSource:0}: Error finding container 3f045d9d298b28271d36d243e801d3939c4aa743ca14029e3635f1a278901a62: Status 404 returned error can't find the container with id 3f045d9d298b28271d36d243e801d3939c4aa743ca14029e3635f1a278901a62
Sep 11 18:19:18.380686 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.380655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gtmqg_ad167720-cf34-47af-bfb4-ff4dcbdd618f/prometheus-operator/0.log"
Sep 11 18:19:18.577148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.577117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gtmqg_ad167720-cf34-47af-bfb4-ff4dcbdd618f/kube-rbac-proxy/0.log"
Sep 11 18:19:18.777073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.777029    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-9t8k6_8133809f-7e9a-41be-979c-034f56afb570/prometheus-operator-admission-webhook/0.log"
Sep 11 18:19:18.782832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.782792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f885666-ztbfd" event={"ID":"d3ea45b5-375f-4859-8ea6-bd5fed793657","Type":"ContainerStarted","Data":"fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d"}
Sep 11 18:19:18.782968 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.782896    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f885666-ztbfd" event={"ID":"d3ea45b5-375f-4859-8ea6-bd5fed793657","Type":"ContainerStarted","Data":"3f045d9d298b28271d36d243e801d3939c4aa743ca14029e3635f1a278901a62"}
Sep 11 18:19:18.803862 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.803814    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5f885666-ztbfd" podStartSLOduration=1.8037952320000001 podStartE2EDuration="1.803795232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:19:18.802645701 +0000 UTC m=+201.377749185" watchObservedRunningTime="2026-09-11 18:19:18.803795232 +0000 UTC m=+201.378898701"
Sep 11 18:19:18.983371 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:18.983330    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fc75994d4-jwjcr_711c62d1-4585-4e20-8624-78f8b0adc1da/telemeter-client/0.log"
Sep 11 18:19:19.177571 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:19.177542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fc75994d4-jwjcr_711c62d1-4585-4e20-8624-78f8b0adc1da/reload/0.log"
Sep 11 18:19:19.378088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:19.378050    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fc75994d4-jwjcr_711c62d1-4585-4e20-8624-78f8b0adc1da/kube-rbac-proxy/0.log"
Sep 11 18:19:19.412965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:19.412914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:19.789132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:19.789098    2561 generic.go:356] "Generic (PLEG): container finished" podID="0a7aaf45-091b-4d43-93a5-cbf82c41c08c" containerID="fa69ba3301e63276411a3de4908669806e2a7dca2107e295c9dc7fe4f347dd1a" exitCode=0
Sep 11 18:19:19.789592 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:19.789183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh" event={"ID":"0a7aaf45-091b-4d43-93a5-cbf82c41c08c","Type":"ContainerDied","Data":"fa69ba3301e63276411a3de4908669806e2a7dca2107e295c9dc7fe4f347dd1a"}
Sep 11 18:19:19.789739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:19.789720    2561 scope.go:117] "RemoveContainer" containerID="fa69ba3301e63276411a3de4908669806e2a7dca2107e295c9dc7fe4f347dd1a"
Sep 11 18:19:20.779517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:20.779483    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-xjdql_3c465316-3fad-4e66-83ba-a33c18b0b503/networking-console-plugin/0.log"
Sep 11 18:19:20.796321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:20.796271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wrqdh" event={"ID":"0a7aaf45-091b-4d43-93a5-cbf82c41c08c","Type":"ContainerStarted","Data":"f3145c6283e17238ab991a691d1460f886ac32558326d743d46b6b8cd49f1df9"}
Sep 11 18:19:21.378191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:21.378157    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5869bd7989-6fjtl_0223d276-6e1d-4a79-9bbe-52b19657fc0c/console/0.log"
Sep 11 18:19:21.578619 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:21.578589    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-c46db_d14c9b87-4f1c-454b-b9ba-f672d7fde88f/download-server/0.log"
Sep 11 18:19:21.827970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:21.827939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:21.896325 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:21.896272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:21.977558 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:21.977521    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sghhm_52319ff3-1bb1-4d09-aa44-67ba79a834b3/serve-healthcheck-canary/0.log"
Sep 11 18:19:27.573492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:27.573456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:27.573989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:27.573544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:27.578178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:27.578158    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:27.838821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:27.838565    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:19:27.888898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:27.888856    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5869bd7989-6fjtl"]
Sep 11 18:19:34.775135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:34.775098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:34.841879 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:34.841848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:35.229877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:35.229831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:35.301597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:35.301565    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:35.866460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:35.866431    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2dc5885-bf5d-491b-9635-a27997baec44" containerID="430e8593463bc5d530a9e4b34eed93694e0f8b517379c74125d4a049f38fe288" exitCode=0
Sep 11 18:19:35.866817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:35.866502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs" event={"ID":"b2dc5885-bf5d-491b-9635-a27997baec44","Type":"ContainerDied","Data":"430e8593463bc5d530a9e4b34eed93694e0f8b517379c74125d4a049f38fe288"}
Sep 11 18:19:35.866861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:35.866848    2561 scope.go:117] "RemoveContainer" containerID="430e8593463bc5d530a9e4b34eed93694e0f8b517379c74125d4a049f38fe288"
Sep 11 18:19:36.873285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:36.873254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6j2zs" event={"ID":"b2dc5885-bf5d-491b-9635-a27997baec44","Type":"ContainerStarted","Data":"7edbbe5f56371b7ebbce10ce8c96abea13b631d89515d24dab67c925f2f75f00"}
Sep 11 18:19:36.876603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:36.876569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:36.975996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:36.975968    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:44.590622 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:44.590582    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:44.652046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:44.652012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:49.772073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:49.772009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:49.842136 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:49.842111    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:52.908821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:52.908782    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5869bd7989-6fjtl" podUID="0223d276-6e1d-4a79-9bbe-52b19657fc0c" containerName="console" containerID="cri-o://ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4" gracePeriod=15
Sep 11 18:19:53.176210 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.176149    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:53.267275 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267240    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-oauth-config\") pod \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") "
Sep 11 18:19:53.267275 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267281    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-serving-cert\") pod \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") "
Sep 11 18:19:53.267579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267339    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-oauth-serving-cert\") pod \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") "
Sep 11 18:19:53.267579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkrzw\" (UniqueName: \"kubernetes.io/projected/0223d276-6e1d-4a79-9bbe-52b19657fc0c-kube-api-access-kkrzw\") pod \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") "
Sep 11 18:19:53.267579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-config\") pod \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") "
Sep 11 18:19:53.267579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267427    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-service-ca\") pod \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\" (UID: \"0223d276-6e1d-4a79-9bbe-52b19657fc0c\") "
Sep 11 18:19:53.267819 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267793    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-config" (OuterVolumeSpecName: "console-config") pod "0223d276-6e1d-4a79-9bbe-52b19657fc0c" (UID: "0223d276-6e1d-4a79-9bbe-52b19657fc0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:19:53.267882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267798    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0223d276-6e1d-4a79-9bbe-52b19657fc0c" (UID: "0223d276-6e1d-4a79-9bbe-52b19657fc0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:19:53.267882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.267860    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "0223d276-6e1d-4a79-9bbe-52b19657fc0c" (UID: "0223d276-6e1d-4a79-9bbe-52b19657fc0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:19:53.269639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.269610    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0223d276-6e1d-4a79-9bbe-52b19657fc0c" (UID: "0223d276-6e1d-4a79-9bbe-52b19657fc0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:19:53.269746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.269691    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0223d276-6e1d-4a79-9bbe-52b19657fc0c" (UID: "0223d276-6e1d-4a79-9bbe-52b19657fc0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:19:53.269746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.269715    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0223d276-6e1d-4a79-9bbe-52b19657fc0c-kube-api-access-kkrzw" (OuterVolumeSpecName: "kube-api-access-kkrzw") pod "0223d276-6e1d-4a79-9bbe-52b19657fc0c" (UID: "0223d276-6e1d-4a79-9bbe-52b19657fc0c"). InnerVolumeSpecName "kube-api-access-kkrzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:19:53.368235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.368208    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:19:53.368235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.368231    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkrzw\" (UniqueName: \"kubernetes.io/projected/0223d276-6e1d-4a79-9bbe-52b19657fc0c-kube-api-access-kkrzw\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:19:53.368235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.368241    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:19:53.368429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.368249    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0223d276-6e1d-4a79-9bbe-52b19657fc0c-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:19:53.368429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.368258    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:19:53.368429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.368267    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0223d276-6e1d-4a79-9bbe-52b19657fc0c-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:19:53.940881 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.940843    2561 generic.go:356] "Generic (PLEG): container finished" podID="0223d276-6e1d-4a79-9bbe-52b19657fc0c" containerID="ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4" exitCode=0
Sep 11 18:19:53.941331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.940898    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5869bd7989-6fjtl"
Sep 11 18:19:53.941331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.940930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5869bd7989-6fjtl" event={"ID":"0223d276-6e1d-4a79-9bbe-52b19657fc0c","Type":"ContainerDied","Data":"ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4"}
Sep 11 18:19:53.941331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.940995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5869bd7989-6fjtl" event={"ID":"0223d276-6e1d-4a79-9bbe-52b19657fc0c","Type":"ContainerDied","Data":"bfcb998a781a93d0d1ed229f5ea080be217b6c7e442a83b7cf1e73ad233b8160"}
Sep 11 18:19:53.941331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.941025    2561 scope.go:117] "RemoveContainer" containerID="ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4"
Sep 11 18:19:53.949886 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.949868    2561 scope.go:117] "RemoveContainer" containerID="ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4"
Sep 11 18:19:53.950149 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:19:53.950131    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4\": container with ID starting with ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4 not found: ID does not exist" containerID="ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4"
Sep 11 18:19:53.950211 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.950155    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4"} err="failed to get container status \"ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4\": rpc error: code = NotFound desc = could not find container \"ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4\": container with ID starting with ecbe516883d9ce3a9980e6ecbbdf113933a979fb3fcfe6e5681b5da14c8f43c4 not found: ID does not exist"
Sep 11 18:19:53.960134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.960107    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5869bd7989-6fjtl"]
Sep 11 18:19:53.964959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:53.964936    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5869bd7989-6fjtl"]
Sep 11 18:19:55.906016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:55.905980    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0223d276-6e1d-4a79-9bbe-52b19657fc0c" path="/var/lib/kubelet/pods/0223d276-6e1d-4a79-9bbe-52b19657fc0c/volumes"
Sep 11 18:19:57.551740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:57.551696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:57.651666 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:57.651632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:58.307630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:58.307593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:19:58.408594 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:19:58.408558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:00.255956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.255922    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f5955f6bd-x59dc"]
Sep 11 18:20:00.256344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.256254    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0223d276-6e1d-4a79-9bbe-52b19657fc0c" containerName="console"
Sep 11 18:20:00.256344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.256265    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0223d276-6e1d-4a79-9bbe-52b19657fc0c" containerName="console"
Sep 11 18:20:00.256344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.256342    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0223d276-6e1d-4a79-9bbe-52b19657fc0c" containerName="console"
Sep 11 18:20:00.292032 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.291997    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5955f6bd-x59dc"]
Sep 11 18:20:00.292181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.292089    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.319754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.319716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:00.421067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.421036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:00.428472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-service-ca\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.428583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-trusted-ca-bundle\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.428583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzv4n\" (UniqueName: \"kubernetes.io/projected/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-kube-api-access-nzv4n\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.428698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-serving-cert\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.428698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-oauth-serving-cert\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.428698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-oauth-config\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.428835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.428764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-config\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529236 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-config\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529236 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-service-ca\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529236 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-trusted-ca-bundle\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv4n\" (UniqueName: \"kubernetes.io/projected/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-kube-api-access-nzv4n\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-serving-cert\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-oauth-serving-cert\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.529491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-oauth-config\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.530015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.529989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-service-ca\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.530015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.530004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-config\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.530164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.530118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-oauth-serving-cert\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.530164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.530132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-trusted-ca-bundle\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.531780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.531751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-serving-cert\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.531874 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.531859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-oauth-config\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.537552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.537531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzv4n\" (UniqueName: \"kubernetes.io/projected/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-kube-api-access-nzv4n\") pod \"console-f5955f6bd-x59dc\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") " pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.600635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.600603    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:00.908382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.908283    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5955f6bd-x59dc"]
Sep 11 18:20:00.913661 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:20:00.913633    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed2ac48_e138_4b7a_bdc1_2a6b0bc1349c.slice/crio-de039c52da55f2cf743a10ea44be2883c0cd2186adf487e290a06bc67a735be5 WatchSource:0}: Error finding container de039c52da55f2cf743a10ea44be2883c0cd2186adf487e290a06bc67a735be5: Status 404 returned error can't find the container with id de039c52da55f2cf743a10ea44be2883c0cd2186adf487e290a06bc67a735be5
Sep 11 18:20:00.969977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:00.969952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5955f6bd-x59dc" event={"ID":"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c","Type":"ContainerStarted","Data":"de039c52da55f2cf743a10ea44be2883c0cd2186adf487e290a06bc67a735be5"}
Sep 11 18:20:01.847118 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847087    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:20:01.847597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847467    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="alertmanager" containerID="cri-o://48bef8d4e6519c8576b1918827626561379aebfcd343eabc219bb9734a8bc54a" gracePeriod=120
Sep 11 18:20:01.847597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847517    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-metric" containerID="cri-o://7e1326db0061d98ced8383f817190057220fbbd10b1f27b9f418a68f02488630" gracePeriod=120
Sep 11 18:20:01.847597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847550    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="prom-label-proxy" containerID="cri-o://dccabbdc305630fc2059fdc618da107e3132a55faf970da271b4d58051fefe97" gracePeriod=120
Sep 11 18:20:01.847597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847576    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-web" containerID="cri-o://281875e3da1f06115a18b3a5910c977eca6d5f8cf2835e5c7c1adcf3a4244a44" gracePeriod=120
Sep 11 18:20:01.847791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847597    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy" containerID="cri-o://ec42d7d6ef7a88355e79639066ca7c5c7578723fa728f9899e7eeefe1f59e578" gracePeriod=120
Sep 11 18:20:01.847791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.847579    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="config-reloader" containerID="cri-o://a835b6b738aadb043edc8b1ad684ba6c70adb092fdc5ddd3068c787ddb197ad0" gracePeriod=120
Sep 11 18:20:01.977828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977803    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="dccabbdc305630fc2059fdc618da107e3132a55faf970da271b4d58051fefe97" exitCode=0
Sep 11 18:20:01.977828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977825    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="ec42d7d6ef7a88355e79639066ca7c5c7578723fa728f9899e7eeefe1f59e578" exitCode=0
Sep 11 18:20:01.977828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977831    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="a835b6b738aadb043edc8b1ad684ba6c70adb092fdc5ddd3068c787ddb197ad0" exitCode=0
Sep 11 18:20:01.977995 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977837    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="48bef8d4e6519c8576b1918827626561379aebfcd343eabc219bb9734a8bc54a" exitCode=0
Sep 11 18:20:01.977995 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"dccabbdc305630fc2059fdc618da107e3132a55faf970da271b4d58051fefe97"}
Sep 11 18:20:01.977995 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"ec42d7d6ef7a88355e79639066ca7c5c7578723fa728f9899e7eeefe1f59e578"}
Sep 11 18:20:01.977995 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.977987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"a835b6b738aadb043edc8b1ad684ba6c70adb092fdc5ddd3068c787ddb197ad0"}
Sep 11 18:20:01.978130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.978030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"48bef8d4e6519c8576b1918827626561379aebfcd343eabc219bb9734a8bc54a"}
Sep 11 18:20:01.979430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:01.979409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5955f6bd-x59dc" event={"ID":"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c","Type":"ContainerStarted","Data":"a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678"}
Sep 11 18:20:02.989352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:02.989294    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="7e1326db0061d98ced8383f817190057220fbbd10b1f27b9f418a68f02488630" exitCode=0
Sep 11 18:20:02.989352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:02.989353    2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerID="281875e3da1f06115a18b3a5910c977eca6d5f8cf2835e5c7c1adcf3a4244a44" exitCode=0
Sep 11 18:20:02.989705 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:02.989331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"7e1326db0061d98ced8383f817190057220fbbd10b1f27b9f418a68f02488630"}
Sep 11 18:20:02.989705 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:02.989474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"281875e3da1f06115a18b3a5910c977eca6d5f8cf2835e5c7c1adcf3a4244a44"}
Sep 11 18:20:03.105448 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.105422    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:03.154956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.154686    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f5955f6bd-x59dc" podStartSLOduration=3.154661851 podStartE2EDuration="3.154661851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:20:01.999881731 +0000 UTC m=+244.574985199" watchObservedRunningTime="2026-09-11 18:20:03.154661851 +0000 UTC m=+245.729765318"
Sep 11 18:20:03.252090 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252098    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-main-tls\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252120    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-out\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252165    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-web\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252198    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-web-config\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252249    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252291    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-main-db\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-tls-assets\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252410    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-metrics-client-ca\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252445    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-cluster-tls-config\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252486    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tzvq\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-kube-api-access-8tzvq\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.252861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252521    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-volume\") pod \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\" (UID: \"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453\") "
Sep 11 18:20:03.253089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.252994    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:20:03.253360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.253277    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:20:03.254061 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.253647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:20:03.255040 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.255013    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-out" (OuterVolumeSpecName: "config-out") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:20:03.255111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.255074    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.255425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.255384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.255870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.255827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.256138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.256112    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.256503 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.256475    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-kube-api-access-8tzvq" (OuterVolumeSpecName: "kube-api-access-8tzvq") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "kube-api-access-8tzvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:20:03.256606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.256583    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-volume" (OuterVolumeSpecName: "config-volume") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.256892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.256875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:20:03.261197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.261174    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.267827 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.267807    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-web-config" (OuterVolumeSpecName: "web-config") pod "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" (UID: "ae4e54a1-4c3f-4d89-a8f8-0e625abdf453"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:03.353449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353409    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353445    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-main-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353456    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-out\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353466    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353475    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-web-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353483    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353494    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-main-db\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353502    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-tls-assets\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353511    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353519    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-metrics-client-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353528    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-cluster-tls-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353536    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tzvq\" (UniqueName: \"kubernetes.io/projected/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-kube-api-access-8tzvq\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:03.353658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:03.353545    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453-config-volume\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:04.002173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.002135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae4e54a1-4c3f-4d89-a8f8-0e625abdf453","Type":"ContainerDied","Data":"b750a6564cc1db35eb164bac5c6ca6b7cd9f14f943cb9564a6fcf77d912703a1"}
Sep 11 18:20:04.002173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.002163    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.002587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.002254    2561 scope.go:117] "RemoveContainer" containerID="dccabbdc305630fc2059fdc618da107e3132a55faf970da271b4d58051fefe97"
Sep 11 18:20:04.009887 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.009855    2561 scope.go:117] "RemoveContainer" containerID="7e1326db0061d98ced8383f817190057220fbbd10b1f27b9f418a68f02488630"
Sep 11 18:20:04.016658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.016641    2561 scope.go:117] "RemoveContainer" containerID="ec42d7d6ef7a88355e79639066ca7c5c7578723fa728f9899e7eeefe1f59e578"
Sep 11 18:20:04.023202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.023182    2561 scope.go:117] "RemoveContainer" containerID="281875e3da1f06115a18b3a5910c977eca6d5f8cf2835e5c7c1adcf3a4244a44"
Sep 11 18:20:04.023707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.023685    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:20:04.030017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.029994    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:20:04.030214 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.030200    2561 scope.go:117] "RemoveContainer" containerID="a835b6b738aadb043edc8b1ad684ba6c70adb092fdc5ddd3068c787ddb197ad0"
Sep 11 18:20:04.036896 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.036879    2561 scope.go:117] "RemoveContainer" containerID="48bef8d4e6519c8576b1918827626561379aebfcd343eabc219bb9734a8bc54a"
Sep 11 18:20:04.043618 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.043602    2561 scope.go:117] "RemoveContainer" containerID="f401b5f631826e57ac45f87af23769aa0f0a947ac6f1e483e131570c2b088379"
Sep 11 18:20:04.061442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061423    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:20:04.061709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061698    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-web"
Sep 11 18:20:04.061752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061711    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-web"
Sep 11 18:20:04.061752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061721    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="alertmanager"
Sep 11 18:20:04.061752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061726    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="alertmanager"
Sep 11 18:20:04.061752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061740    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="config-reloader"
Sep 11 18:20:04.061752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061745    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="config-reloader"
Sep 11 18:20:04.061752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061751    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-metric"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061757    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-metric"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061763    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="prom-label-proxy"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061768    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="prom-label-proxy"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061774    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061778    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061785    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="init-config-reloader"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061790    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="init-config-reloader"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061842    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-metric"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061850    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061856    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="config-reloader"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061863    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="alertmanager"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061869    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="kube-rbac-proxy-web"
Sep 11 18:20:04.061928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.061875    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" containerName="prom-label-proxy"
Sep 11 18:20:04.065525 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.065510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.070084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.069912    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 18:20:04.070084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.069955    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 18:20:04.070084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.069970    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 18:20:04.070084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.070003    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 18:20:04.070084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.069956    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mc42v\""
Sep 11 18:20:04.070084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.070067    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 18:20:04.070515 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.070285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 18:20:04.070688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.070669    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 18:20:04.071017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.070995    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 18:20:04.075808 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.075793    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 18:20:04.083206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.083184    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:20:04.160876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.160840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.160876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.160875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa919ee5-4c25-4678-8adf-e40b6ba51264-config-out\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.160904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.160985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-web-config\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa919ee5-4c25-4678-8adf-e40b6ba51264-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161200 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa919ee5-4c25-4678-8adf-e40b6ba51264-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161200 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa919ee5-4c25-4678-8adf-e40b6ba51264-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161200 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa919ee5-4c25-4678-8adf-e40b6ba51264-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161200 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6krg\" (UniqueName: \"kubernetes.io/projected/fa919ee5-4c25-4678-8adf-e40b6ba51264-kube-api-access-t6krg\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.161425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.161370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.261836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.261797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.261836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.261840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6krg\" (UniqueName: \"kubernetes.io/projected/fa919ee5-4c25-4678-8adf-e40b6ba51264-kube-api-access-t6krg\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.261874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.261917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.261938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa919ee5-4c25-4678-8adf-e40b6ba51264-config-out\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.261980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-web-config\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa919ee5-4c25-4678-8adf-e40b6ba51264-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa919ee5-4c25-4678-8adf-e40b6ba51264-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa919ee5-4c25-4678-8adf-e40b6ba51264-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa919ee5-4c25-4678-8adf-e40b6ba51264-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.262438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.262210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.263292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.263077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa919ee5-4c25-4678-8adf-e40b6ba51264-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.263437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.263389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa919ee5-4c25-4678-8adf-e40b6ba51264-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.263837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.263802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa919ee5-4c25-4678-8adf-e40b6ba51264-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.265073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.265042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.265181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.265049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.265697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.265481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-web-config\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.265697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.265561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.265941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.265913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.266095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.266079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.266164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.266099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa919ee5-4c25-4678-8adf-e40b6ba51264-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.266164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.266130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa919ee5-4c25-4678-8adf-e40b6ba51264-config-out\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.266735 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.266714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa919ee5-4c25-4678-8adf-e40b6ba51264-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.270800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.270784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6krg\" (UniqueName: \"kubernetes.io/projected/fa919ee5-4c25-4678-8adf-e40b6ba51264-kube-api-access-t6krg\") pod \"alertmanager-main-0\" (UID: \"fa919ee5-4c25-4678-8adf-e40b6ba51264\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.377241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.377206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:20:04.659004 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:04.658979    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:20:04.659852 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:20:04.659817    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa919ee5_4c25_4678_8adf_e40b6ba51264.slice/crio-ae6d8eb147f2f7acb7362b3f763cc2e445ddd1d805e115a53db107b731da9b3a WatchSource:0}: Error finding container ae6d8eb147f2f7acb7362b3f763cc2e445ddd1d805e115a53db107b731da9b3a: Status 404 returned error can't find the container with id ae6d8eb147f2f7acb7362b3f763cc2e445ddd1d805e115a53db107b731da9b3a
Sep 11 18:20:05.008583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:05.008548    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa919ee5-4c25-4678-8adf-e40b6ba51264" containerID="b8099805839982ff4282447812274c68071ea31c2fe5d1ee0ad99a83a6dd8c3e" exitCode=0
Sep 11 18:20:05.009057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:05.008590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerDied","Data":"b8099805839982ff4282447812274c68071ea31c2fe5d1ee0ad99a83a6dd8c3e"}
Sep 11 18:20:05.009057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:05.008653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"ae6d8eb147f2f7acb7362b3f763cc2e445ddd1d805e115a53db107b731da9b3a"}
Sep 11 18:20:05.907841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:05.907799    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4e54a1-4c3f-4d89-a8f8-0e625abdf453" path="/var/lib/kubelet/pods/ae4e54a1-4c3f-4d89-a8f8-0e625abdf453/volumes"
Sep 11 18:20:06.016914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.016879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"7c9d730bfae99a24b4aad5ff01b378b57dd30bc87a73af50ccfa87cb2064404d"}
Sep 11 18:20:06.017313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.016948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"9e8dbb932a701a712c1d0127f019ae6847a3bb5ab9b6035c798d1af82edf9263"}
Sep 11 18:20:06.017313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.016973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"36246cd98627d3fc496a39fc99f59e787659a3ab215ca5801e75dc8874eb2caa"}
Sep 11 18:20:06.017313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.016999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"857468f88bbd950e555e43f8d140ffa20218a4111a572d5c910ee1dac1249e3b"}
Sep 11 18:20:06.017313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.017022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"f68fb30fcdd08e55317d2c2fa719ce89c06fa866cbf30d259c4f8679d3266574"}
Sep 11 18:20:06.017313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.017043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa919ee5-4c25-4678-8adf-e40b6ba51264","Type":"ContainerStarted","Data":"40dfe81173f43e95e3ee2a903c1804fce2ab05b6be2d65831750c2bb4e051cb6"}
Sep 11 18:20:06.047794 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:06.047747    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.032727993 podStartE2EDuration="2.047728553s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.00056ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:20:06.045619242 +0000 UTC m=+248.620722699" watchObservedRunningTime="2026-09-11 18:20:06.047728553 +0000 UTC m=+248.622832020"
Sep 11 18:20:08.701596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:08.701553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:20:08.703881 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:08.703863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaafbc73-c564-4e71-81ac-eb55aba7b147-metrics-certs\") pod \"network-metrics-daemon-vxrl6\" (UID: \"eaafbc73-c564-4e71-81ac-eb55aba7b147\") " pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:20:08.907659 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:08.907630    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bn27r\""
Sep 11 18:20:08.915732 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:08.915714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxrl6"
Sep 11 18:20:09.189885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:09.189855    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vxrl6"]
Sep 11 18:20:09.192884 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:20:09.192846    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaafbc73_c564_4e71_81ac_eb55aba7b147.slice/crio-15e1ee58986aa415dbb6d9ec812a891f9b86997a8909ad6382df5c1d8615f712 WatchSource:0}: Error finding container 15e1ee58986aa415dbb6d9ec812a891f9b86997a8909ad6382df5c1d8615f712: Status 404 returned error can't find the container with id 15e1ee58986aa415dbb6d9ec812a891f9b86997a8909ad6382df5c1d8615f712
Sep 11 18:20:09.533673 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:09.533635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:09.626023 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:09.625967    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:10.034330 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:10.034174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxrl6" event={"ID":"eaafbc73-c564-4e71-81ac-eb55aba7b147","Type":"ContainerStarted","Data":"15e1ee58986aa415dbb6d9ec812a891f9b86997a8909ad6382df5c1d8615f712"}
Sep 11 18:20:10.601211 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:10.601174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:10.601423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:10.601363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:10.606063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:10.606042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:11.040393 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.040359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxrl6" event={"ID":"eaafbc73-c564-4e71-81ac-eb55aba7b147","Type":"ContainerStarted","Data":"336e8bf611a2bcfa2bf7f084e7c6d01871b9121f8030f9c4b609cd2eebc6448c"}
Sep 11 18:20:11.040851 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.040414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxrl6" event={"ID":"eaafbc73-c564-4e71-81ac-eb55aba7b147","Type":"ContainerStarted","Data":"859047f62b4e152606c59a423148c5c7dbeb3aab9543ff0cd8bec6945cbc0fac"}
Sep 11 18:20:11.044327 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.044255    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:20:11.060201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.060156    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vxrl6" podStartSLOduration=253.226088575 podStartE2EDuration="4m14.060141969s" totalImagesPullingTime="834.053394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:20:11.059472733 +0000 UTC m=+253.634576202" watchObservedRunningTime="2026-09-11 18:20:11.060141969 +0000 UTC m=+253.635245437"
Sep 11 18:20:11.112356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.112322    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5f885666-ztbfd"]
Sep 11 18:20:11.181662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.181627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:11.285548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.285498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:11.381457 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.381377    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:11.487251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:11.487216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:19.779814 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:19.779775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:19.881749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:19.881712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:36.133064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.133019    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f5f885666-ztbfd" podUID="d3ea45b5-375f-4859-8ea6-bd5fed793657" containerName="console" containerID="cri-o://fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d" gracePeriod=15
Sep 11 18:20:36.371148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.371123    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:20:36.440157 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440065    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-trusted-ca-bundle\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440157 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440140    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-serving-cert\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-service-ca\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440195    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-oauth-config\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440218    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npl79\" (UniqueName: \"kubernetes.io/projected/d3ea45b5-375f-4859-8ea6-bd5fed793657-kube-api-access-npl79\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-oauth-serving-cert\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-config\") pod \"d3ea45b5-375f-4859-8ea6-bd5fed793657\" (UID: \"d3ea45b5-375f-4859-8ea6-bd5fed793657\") "
Sep 11 18:20:36.440651 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440628    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:20:36.440710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440637    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:20:36.440761 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:20:36.440930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.440909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-config" (OuterVolumeSpecName: "console-config") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:20:36.442452 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.442428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:36.442922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.442893    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:20:36.443020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.442922    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ea45b5-375f-4859-8ea6-bd5fed793657-kube-api-access-npl79" (OuterVolumeSpecName: "kube-api-access-npl79") pod "d3ea45b5-375f-4859-8ea6-bd5fed793657" (UID: "d3ea45b5-375f-4859-8ea6-bd5fed793657"). InnerVolumeSpecName "kube-api-access-npl79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:20:36.541093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541057    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.541093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541086    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npl79\" (UniqueName: \"kubernetes.io/projected/d3ea45b5-375f-4859-8ea6-bd5fed793657-kube-api-access-npl79\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.541093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541096    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.541356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541105    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.541356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541114    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-trusted-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.541356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541123    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ea45b5-375f-4859-8ea6-bd5fed793657-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.541356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.541131    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ea45b5-375f-4859-8ea6-bd5fed793657-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:20:36.707824 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:36.707734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:37.162361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.162292    2561 generic.go:356] "Generic (PLEG): container finished" podID="d3ea45b5-375f-4859-8ea6-bd5fed793657" containerID="fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d" exitCode=0
Sep 11 18:20:37.162361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.162357    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5f885666-ztbfd"
Sep 11 18:20:37.162863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.162397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f885666-ztbfd" event={"ID":"d3ea45b5-375f-4859-8ea6-bd5fed793657","Type":"ContainerDied","Data":"fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d"}
Sep 11 18:20:37.162863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.162452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5f885666-ztbfd" event={"ID":"d3ea45b5-375f-4859-8ea6-bd5fed793657","Type":"ContainerDied","Data":"3f045d9d298b28271d36d243e801d3939c4aa743ca14029e3635f1a278901a62"}
Sep 11 18:20:37.162863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.162473    2561 scope.go:117] "RemoveContainer" containerID="fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d"
Sep 11 18:20:37.171422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.171402    2561 scope.go:117] "RemoveContainer" containerID="fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d"
Sep 11 18:20:37.171698 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:20:37.171679    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d\": container with ID starting with fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d not found: ID does not exist" containerID="fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d"
Sep 11 18:20:37.171747 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.171707    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d"} err="failed to get container status \"fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d\": rpc error: code = NotFound desc = could not find container \"fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d\": container with ID starting with fcf8c6451b05e9fcc89f91777e393475cfdfe27f2a0faa31f80650121923cb8d not found: ID does not exist"
Sep 11 18:20:37.186072 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.186042    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5f885666-ztbfd"]
Sep 11 18:20:37.189765 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.189744    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5f885666-ztbfd"]
Sep 11 18:20:37.906722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:37.906687    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ea45b5-375f-4859-8ea6-bd5fed793657" path="/var/lib/kubelet/pods/d3ea45b5-375f-4859-8ea6-bd5fed793657/volumes"
Sep 11 18:20:40.915507 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:40.915460    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:40.965876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:40.965830    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:46.923405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:46.923366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:20:57.783986 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:57.783958    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:20:57.788327 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:57.788292    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:20:57.788441 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:20:57.788431    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 18:21:19.653688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:19.653655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:19.748479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:19.748442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:20.284003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.283967    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"]
Sep 11 18:21:20.284321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.284294    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ea45b5-375f-4859-8ea6-bd5fed793657" containerName="console"
Sep 11 18:21:20.284379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.284323    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ea45b5-375f-4859-8ea6-bd5fed793657" containerName="console"
Sep 11 18:21:20.284421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.284381    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ea45b5-375f-4859-8ea6-bd5fed793657" containerName="console"
Sep 11 18:21:20.286546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.286529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.288955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.288936    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:21:20.289053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.289000    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:21:20.289717 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.289690    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drtxq\""
Sep 11 18:21:20.295733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.295711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"]
Sep 11 18:21:20.318052 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.318027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.318164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.318064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czl7x\" (UniqueName: \"kubernetes.io/projected/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-kube-api-access-czl7x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.318164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.318119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.419191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.419153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.419405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.419208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czl7x\" (UniqueName: \"kubernetes.io/projected/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-kube-api-access-czl7x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.419405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.419258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.419649 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.419624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.419707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.419637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.427455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.427428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czl7x\" (UniqueName: \"kubernetes.io/projected/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-kube-api-access-czl7x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.596205 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.596120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:20.865886 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.865860    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"]
Sep 11 18:21:20.868694 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:21:20.868666    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc745dfa2_e6ba_479d_9d99_d13feb8b29e5.slice/crio-8c33fb936ecf861a1180fe4a8c87f073c60d4648407fcc4c0a64a33b02aef23b WatchSource:0}: Error finding container 8c33fb936ecf861a1180fe4a8c87f073c60d4648407fcc4c0a64a33b02aef23b: Status 404 returned error can't find the container with id 8c33fb936ecf861a1180fe4a8c87f073c60d4648407fcc4c0a64a33b02aef23b
Sep 11 18:21:20.870771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:20.870750    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:21:21.350618 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:21.350586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw" event={"ID":"c745dfa2-e6ba-479d-9d99-d13feb8b29e5","Type":"ContainerStarted","Data":"8c33fb936ecf861a1180fe4a8c87f073c60d4648407fcc4c0a64a33b02aef23b"}
Sep 11 18:21:25.726340 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:25.726287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:28.387118 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:28.387081    2561 generic.go:356] "Generic (PLEG): container finished" podID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerID="94d347e78ad304f8a88f9cb1a0bb6bb734cc636b059cbf0fc2f9629bd7815cab" exitCode=0
Sep 11 18:21:28.387546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:28.387171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw" event={"ID":"c745dfa2-e6ba-479d-9d99-d13feb8b29e5","Type":"ContainerDied","Data":"94d347e78ad304f8a88f9cb1a0bb6bb734cc636b059cbf0fc2f9629bd7815cab"}
Sep 11 18:21:31.402389 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:31.402354    2561 generic.go:356] "Generic (PLEG): container finished" podID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerID="d88c9b54e9b0fc187a2a37b950e6bd9ebffd1282a8129452ac6083820f638552" exitCode=0
Sep 11 18:21:31.402762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:31.402438    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw" event={"ID":"c745dfa2-e6ba-479d-9d99-d13feb8b29e5","Type":"ContainerDied","Data":"d88c9b54e9b0fc187a2a37b950e6bd9ebffd1282a8129452ac6083820f638552"}
Sep 11 18:21:39.439837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:39.439800    2561 generic.go:356] "Generic (PLEG): container finished" podID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerID="971f3d4bf604d0b3392193b59808215bd1005621568da2ccb33e2ae8c819c9ab" exitCode=0
Sep 11 18:21:39.440257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:39.439881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw" event={"ID":"c745dfa2-e6ba-479d-9d99-d13feb8b29e5","Type":"ContainerDied","Data":"971f3d4bf604d0b3392193b59808215bd1005621568da2ccb33e2ae8c819c9ab"}
Sep 11 18:21:40.566874 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.566848    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:40.704614 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.704531    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czl7x\" (UniqueName: \"kubernetes.io/projected/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-kube-api-access-czl7x\") pod \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") "
Sep 11 18:21:40.704614 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.704574    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-bundle\") pod \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") "
Sep 11 18:21:40.704841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.704671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-util\") pod \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\" (UID: \"c745dfa2-e6ba-479d-9d99-d13feb8b29e5\") "
Sep 11 18:21:40.705286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.705260    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-bundle" (OuterVolumeSpecName: "bundle") pod "c745dfa2-e6ba-479d-9d99-d13feb8b29e5" (UID: "c745dfa2-e6ba-479d-9d99-d13feb8b29e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:21:40.706841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.706816    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-kube-api-access-czl7x" (OuterVolumeSpecName: "kube-api-access-czl7x") pod "c745dfa2-e6ba-479d-9d99-d13feb8b29e5" (UID: "c745dfa2-e6ba-479d-9d99-d13feb8b29e5"). InnerVolumeSpecName "kube-api-access-czl7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:21:40.709172 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.709153    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-util" (OuterVolumeSpecName: "util") pod "c745dfa2-e6ba-479d-9d99-d13feb8b29e5" (UID: "c745dfa2-e6ba-479d-9d99-d13feb8b29e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:21:40.806222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.806186    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:21:40.806222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.806214    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czl7x\" (UniqueName: \"kubernetes.io/projected/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-kube-api-access-czl7x\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:21:40.806222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:40.806225    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c745dfa2-e6ba-479d-9d99-d13feb8b29e5-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:21:41.449774 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:41.449741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw" event={"ID":"c745dfa2-e6ba-479d-9d99-d13feb8b29e5","Type":"ContainerDied","Data":"8c33fb936ecf861a1180fe4a8c87f073c60d4648407fcc4c0a64a33b02aef23b"}
Sep 11 18:21:41.449919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:41.449789    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c33fb936ecf861a1180fe4a8c87f073c60d4648407fcc4c0a64a33b02aef23b"
Sep 11 18:21:41.449919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:41.449787    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxdfw"
Sep 11 18:21:46.335602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:46.335568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:47.158518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:47.158468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:48.255723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.255690    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"]
Sep 11 18:21:48.256124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256063    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="pull"
Sep 11 18:21:48.256124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256075    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="pull"
Sep 11 18:21:48.256124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256086    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="util"
Sep 11 18:21:48.256124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256092    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="util"
Sep 11 18:21:48.256124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256111    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="extract"
Sep 11 18:21:48.256124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256120    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="extract"
Sep 11 18:21:48.256341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.256175    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c745dfa2-e6ba-479d-9d99-d13feb8b29e5" containerName="extract"
Sep 11 18:21:48.310028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.309997    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"]
Sep 11 18:21:48.310179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.310101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.312665 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.312646    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 18:21:48.312792 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.312714    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:21:48.312909 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.312895    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4kff6\""
Sep 11 18:21:48.471769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.471738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc72f20c-a3f4-43ed-96ec-cd385d5504a7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pbwrf\" (UID: \"cc72f20c-a3f4-43ed-96ec-cd385d5504a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.471925 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.471818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddj7\" (UniqueName: \"kubernetes.io/projected/cc72f20c-a3f4-43ed-96ec-cd385d5504a7-kube-api-access-cddj7\") pod \"cert-manager-operator-controller-manager-55c444bf86-pbwrf\" (UID: \"cc72f20c-a3f4-43ed-96ec-cd385d5504a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.573286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.573208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddj7\" (UniqueName: \"kubernetes.io/projected/cc72f20c-a3f4-43ed-96ec-cd385d5504a7-kube-api-access-cddj7\") pod \"cert-manager-operator-controller-manager-55c444bf86-pbwrf\" (UID: \"cc72f20c-a3f4-43ed-96ec-cd385d5504a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.573286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.573273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc72f20c-a3f4-43ed-96ec-cd385d5504a7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pbwrf\" (UID: \"cc72f20c-a3f4-43ed-96ec-cd385d5504a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.573718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.573698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc72f20c-a3f4-43ed-96ec-cd385d5504a7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pbwrf\" (UID: \"cc72f20c-a3f4-43ed-96ec-cd385d5504a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.582432 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.582411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddj7\" (UniqueName: \"kubernetes.io/projected/cc72f20c-a3f4-43ed-96ec-cd385d5504a7-kube-api-access-cddj7\") pod \"cert-manager-operator-controller-manager-55c444bf86-pbwrf\" (UID: \"cc72f20c-a3f4-43ed-96ec-cd385d5504a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.619392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.619363    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"
Sep 11 18:21:48.919559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:48.919505    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf"]
Sep 11 18:21:48.922131 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:21:48.922098    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc72f20c_a3f4_43ed_96ec_cd385d5504a7.slice/crio-199b38f826c3f0d0ad72cdd9e390ed2543bd42118337238b5d32257648bb3912 WatchSource:0}: Error finding container 199b38f826c3f0d0ad72cdd9e390ed2543bd42118337238b5d32257648bb3912: Status 404 returned error can't find the container with id 199b38f826c3f0d0ad72cdd9e390ed2543bd42118337238b5d32257648bb3912
Sep 11 18:21:49.484923 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:49.484885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf" event={"ID":"cc72f20c-a3f4-43ed-96ec-cd385d5504a7","Type":"ContainerStarted","Data":"199b38f826c3f0d0ad72cdd9e390ed2543bd42118337238b5d32257648bb3912"}
Sep 11 18:21:49.948565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:49.948519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:50.050413 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:50.050382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:51.497412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:51.497327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf" event={"ID":"cc72f20c-a3f4-43ed-96ec-cd385d5504a7","Type":"ContainerStarted","Data":"a00e548b46ede47d154508231e013383cae0a5d297d9333a0ee3fcbe9abdf188"}
Sep 11 18:21:51.519989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:51.519937    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pbwrf" podStartSLOduration=1.226876846 podStartE2EDuration="3.519914607s" totalImagesPullingTime="2.293037761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:21:51.518989992 +0000 UTC m=+354.094093461" watchObservedRunningTime="2026-09-11 18:21:51.519914607 +0000 UTC m=+354.095018081"
Sep 11 18:21:51.779189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:51.779153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:51.885351 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:51.885291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:52.102134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.102040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:52.196461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.196413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:52.642561 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.642525    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"]
Sep 11 18:21:52.645102 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.645084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.647531 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.647511    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:21:52.648437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.648422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drtxq\""
Sep 11 18:21:52.648540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.648451    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:21:52.656806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.656785    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"]
Sep 11 18:21:52.809588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.809545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.809767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.809605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwpfl\" (UniqueName: \"kubernetes.io/projected/941620bc-f151-4e2b-a57b-36c32ce01acd-kube-api-access-dwpfl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.809767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.809674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.911182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.911094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwpfl\" (UniqueName: \"kubernetes.io/projected/941620bc-f151-4e2b-a57b-36c32ce01acd-kube-api-access-dwpfl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.911182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.911146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.911401 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.911208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.911582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.911565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.911643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.911623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.919873 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.919850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwpfl\" (UniqueName: \"kubernetes.io/projected/941620bc-f151-4e2b-a57b-36c32ce01acd-kube-api-access-dwpfl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:52.953602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:52.953571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:53.230944 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:53.230916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"]
Sep 11 18:21:53.233616 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:21:53.233586    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941620bc_f151_4e2b_a57b_36c32ce01acd.slice/crio-26a82b7b5a43c71bd40f5d78e68bcbd90f90139d2a441b2f17778cb59a74f6dd WatchSource:0}: Error finding container 26a82b7b5a43c71bd40f5d78e68bcbd90f90139d2a441b2f17778cb59a74f6dd: Status 404 returned error can't find the container with id 26a82b7b5a43c71bd40f5d78e68bcbd90f90139d2a441b2f17778cb59a74f6dd
Sep 11 18:21:53.508516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:53.508485    2561 generic.go:356] "Generic (PLEG): container finished" podID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerID="762b6e22a5fb76d88d5f0cfbb1d237b0f2eee7a0a9bff69dc1ea53a8535fd1f1" exitCode=0
Sep 11 18:21:53.508687 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:53.508556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp" event={"ID":"941620bc-f151-4e2b-a57b-36c32ce01acd","Type":"ContainerDied","Data":"762b6e22a5fb76d88d5f0cfbb1d237b0f2eee7a0a9bff69dc1ea53a8535fd1f1"}
Sep 11 18:21:53.508687 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:53.508592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp" event={"ID":"941620bc-f151-4e2b-a57b-36c32ce01acd","Type":"ContainerStarted","Data":"26a82b7b5a43c71bd40f5d78e68bcbd90f90139d2a441b2f17778cb59a74f6dd"}
Sep 11 18:21:53.596345 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:53.596288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:54.172364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.172246    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:54.552622 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.552583    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wl7qj"]
Sep 11 18:21:54.555121 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.555097    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.557584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.557560    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 18:21:54.557694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.557560    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 18:21:54.558586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.558566    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z44gs\""
Sep 11 18:21:54.564094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.564073    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wl7qj"]
Sep 11 18:21:54.727417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.727375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j69hk\" (UniqueName: \"kubernetes.io/projected/fef34aa1-ccdf-4632-8618-5be508afac57-kube-api-access-j69hk\") pod \"cert-manager-webhook-6486ffd997-wl7qj\" (UID: \"fef34aa1-ccdf-4632-8618-5be508afac57\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.727610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.727457    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fef34aa1-ccdf-4632-8618-5be508afac57-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wl7qj\" (UID: \"fef34aa1-ccdf-4632-8618-5be508afac57\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.828653 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.828581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hk\" (UniqueName: \"kubernetes.io/projected/fef34aa1-ccdf-4632-8618-5be508afac57-kube-api-access-j69hk\") pod \"cert-manager-webhook-6486ffd997-wl7qj\" (UID: \"fef34aa1-ccdf-4632-8618-5be508afac57\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.828653 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.828641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fef34aa1-ccdf-4632-8618-5be508afac57-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wl7qj\" (UID: \"fef34aa1-ccdf-4632-8618-5be508afac57\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.837865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.837834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fef34aa1-ccdf-4632-8618-5be508afac57-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wl7qj\" (UID: \"fef34aa1-ccdf-4632-8618-5be508afac57\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.838009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.837890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j69hk\" (UniqueName: \"kubernetes.io/projected/fef34aa1-ccdf-4632-8618-5be508afac57-kube-api-access-j69hk\") pod \"cert-manager-webhook-6486ffd997-wl7qj\" (UID: \"fef34aa1-ccdf-4632-8618-5be508afac57\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:54.875884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:54.875853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:55.522364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:55.522326    2561 generic.go:356] "Generic (PLEG): container finished" podID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerID="0519e728a2bf418532e8f3e9f20fa33989318914a0f0b21f40a098bb87e8e89c" exitCode=0
Sep 11 18:21:55.522732 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:55.522389    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp" event={"ID":"941620bc-f151-4e2b-a57b-36c32ce01acd","Type":"ContainerDied","Data":"0519e728a2bf418532e8f3e9f20fa33989318914a0f0b21f40a098bb87e8e89c"}
Sep 11 18:21:55.580068 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:55.580043    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wl7qj"]
Sep 11 18:21:55.582129 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:21:55.582109    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfef34aa1_ccdf_4632_8618_5be508afac57.slice/crio-822a6a54c1b1ad4baa0c1ad5105f49c491df45bb23a241ba69d048ba6d37e63f WatchSource:0}: Error finding container 822a6a54c1b1ad4baa0c1ad5105f49c491df45bb23a241ba69d048ba6d37e63f: Status 404 returned error can't find the container with id 822a6a54c1b1ad4baa0c1ad5105f49c491df45bb23a241ba69d048ba6d37e63f
Sep 11 18:21:56.529852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:56.529813    2561 generic.go:356] "Generic (PLEG): container finished" podID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerID="8a107de44a60f75c975bbf50f83195a5079bfcb4541f83ddc561174949380306" exitCode=0
Sep 11 18:21:56.530324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:56.529908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp" event={"ID":"941620bc-f151-4e2b-a57b-36c32ce01acd","Type":"ContainerDied","Data":"8a107de44a60f75c975bbf50f83195a5079bfcb4541f83ddc561174949380306"}
Sep 11 18:21:56.531512 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:56.531484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj" event={"ID":"fef34aa1-ccdf-4632-8618-5be508afac57","Type":"ContainerStarted","Data":"822a6a54c1b1ad4baa0c1ad5105f49c491df45bb23a241ba69d048ba6d37e63f"}
Sep 11 18:21:56.739270 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:56.739182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:56.840182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:56.840141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:58.122730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.122699    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:58.259263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.259228    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-util\") pod \"941620bc-f151-4e2b-a57b-36c32ce01acd\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") "
Sep 11 18:21:58.259443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.259271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwpfl\" (UniqueName: \"kubernetes.io/projected/941620bc-f151-4e2b-a57b-36c32ce01acd-kube-api-access-dwpfl\") pod \"941620bc-f151-4e2b-a57b-36c32ce01acd\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") "
Sep 11 18:21:58.259443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.259330    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-bundle\") pod \"941620bc-f151-4e2b-a57b-36c32ce01acd\" (UID: \"941620bc-f151-4e2b-a57b-36c32ce01acd\") "
Sep 11 18:21:58.259720 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.259682    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-bundle" (OuterVolumeSpecName: "bundle") pod "941620bc-f151-4e2b-a57b-36c32ce01acd" (UID: "941620bc-f151-4e2b-a57b-36c32ce01acd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:21:58.261353 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.261329    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941620bc-f151-4e2b-a57b-36c32ce01acd-kube-api-access-dwpfl" (OuterVolumeSpecName: "kube-api-access-dwpfl") pod "941620bc-f151-4e2b-a57b-36c32ce01acd" (UID: "941620bc-f151-4e2b-a57b-36c32ce01acd"). InnerVolumeSpecName "kube-api-access-dwpfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:21:58.264266 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.264223    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-util" (OuterVolumeSpecName: "util") pod "941620bc-f151-4e2b-a57b-36c32ce01acd" (UID: "941620bc-f151-4e2b-a57b-36c32ce01acd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:21:58.360954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.360867    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:21:58.360954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.360903    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwpfl\" (UniqueName: \"kubernetes.io/projected/941620bc-f151-4e2b-a57b-36c32ce01acd-kube-api-access-dwpfl\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:21:58.360954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.360914    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/941620bc-f151-4e2b-a57b-36c32ce01acd-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:21:58.543146 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.543119    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp"
Sep 11 18:21:58.543349 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.543112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wmkp" event={"ID":"941620bc-f151-4e2b-a57b-36c32ce01acd","Type":"ContainerDied","Data":"26a82b7b5a43c71bd40f5d78e68bcbd90f90139d2a441b2f17778cb59a74f6dd"}
Sep 11 18:21:58.543349 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.543254    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26a82b7b5a43c71bd40f5d78e68bcbd90f90139d2a441b2f17778cb59a74f6dd"
Sep 11 18:21:58.544820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.544796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj" event={"ID":"fef34aa1-ccdf-4632-8618-5be508afac57","Type":"ContainerStarted","Data":"c87b2e9f747102d4814ce828cdf4ac03dc7c4a867a69a6153f30451c223f9178"}
Sep 11 18:21:58.544930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.544850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:21:58.562010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.561966    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj" podStartSLOduration=2.004500212 podStartE2EDuration="4.561952111s" totalImagesPullingTime="2.557451899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:21:58.560721107 +0000 UTC m=+361.135824576" watchObservedRunningTime="2026-09-11 18:21:58.561952111 +0000 UTC m=+361.137055578"
Sep 11 18:21:58.852268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.852239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:21:58.912318 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:21:58.912270    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:00.546731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:00.546700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:00.646733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:00.646700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:02.574339 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574291    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"]
Sep 11 18:22:02.574731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574655    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="pull"
Sep 11 18:22:02.574731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574666    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="pull"
Sep 11 18:22:02.574731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574680    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="util"
Sep 11 18:22:02.574731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574685    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="util"
Sep 11 18:22:02.574731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574703    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="extract"
Sep 11 18:22:02.574731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574709    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="extract"
Sep 11 18:22:02.574935 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.574787    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="941620bc-f151-4e2b-a57b-36c32ce01acd" containerName="extract"
Sep 11 18:22:02.576783 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.576767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.579322 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.579289    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:22:02.580269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.580254    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 18:22:02.580377 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.580273    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qbzg8\""
Sep 11 18:22:02.585563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.585538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"]
Sep 11 18:22:02.598056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.598022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4fg\" (UniqueName: \"kubernetes.io/projected/d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc-kube-api-access-nt4fg\") pod \"openshift-lws-operator-fd8ccff4c-w7jjn\" (UID: \"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.598186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.598141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w7jjn\" (UID: \"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.698564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.698521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4fg\" (UniqueName: \"kubernetes.io/projected/d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc-kube-api-access-nt4fg\") pod \"openshift-lws-operator-fd8ccff4c-w7jjn\" (UID: \"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.698763 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.698621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w7jjn\" (UID: \"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.699008 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.698985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w7jjn\" (UID: \"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.706214 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.706177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4fg\" (UniqueName: \"kubernetes.io/projected/d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc-kube-api-access-nt4fg\") pod \"openshift-lws-operator-fd8ccff4c-w7jjn\" (UID: \"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.887121 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.887042    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"
Sep 11 18:22:02.987158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:02.987124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:03.159142 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:03.159119    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn"]
Sep 11 18:22:03.161805 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:03.161775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd92aa0b9_08f1_4cf1_89a4_f1e44492f8cc.slice/crio-2ab4c0685274098fe5593afa10ce58a6991e0974456a051a8f9380cdeda312e3 WatchSource:0}: Error finding container 2ab4c0685274098fe5593afa10ce58a6991e0974456a051a8f9380cdeda312e3: Status 404 returned error can't find the container with id 2ab4c0685274098fe5593afa10ce58a6991e0974456a051a8f9380cdeda312e3
Sep 11 18:22:03.573498 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:03.573461    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn" event={"ID":"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc","Type":"ContainerStarted","Data":"2ab4c0685274098fe5593afa10ce58a6991e0974456a051a8f9380cdeda312e3"}
Sep 11 18:22:04.552038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:04.552009    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wl7qj"
Sep 11 18:22:05.585639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:05.585602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn" event={"ID":"d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc","Type":"ContainerStarted","Data":"f67becb970a852a96bf72f32522b0439bcefc7c6857254c62a153c20d84d9ad8"}
Sep 11 18:22:05.601198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:05.601150    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7jjn" podStartSLOduration=1.7371677399999998 podStartE2EDuration="3.601132918s" totalImagesPullingTime="1.863965178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:05.600494584 +0000 UTC m=+368.175598050" watchObservedRunningTime="2026-09-11 18:22:05.601132918 +0000 UTC m=+368.176236386"
Sep 11 18:22:06.354063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:06.354027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:06.450284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:06.450244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:08.139046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.139009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:08.219757 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.219721    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"]
Sep 11 18:22:08.222429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.222408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.224827 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.224802    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:22:08.224944 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.224849    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drtxq\""
Sep 11 18:22:08.225524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.225507    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:22:08.232126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.232102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"]
Sep 11 18:22:08.244830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.244797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.245071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.244841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.245071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.244879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm7ql\" (UniqueName: \"kubernetes.io/projected/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-kube-api-access-qm7ql\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.345926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.345888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.346101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.345938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.346101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.345963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm7ql\" (UniqueName: \"kubernetes.io/projected/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-kube-api-access-qm7ql\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.346369 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.346346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.346410 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.346362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.355480 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.355457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm7ql\" (UniqueName: \"kubernetes.io/projected/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-kube-api-access-qm7ql\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.533483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.533441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:08.805511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:08.805485    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"]
Sep 11 18:22:08.807556 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:08.807515    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478c2734_c9a4_47c6_8caf_3b3f0f29ba36.slice/crio-3b9b1238368d96865a6415c0beccc7d4078f7153467ecaf602faed18c9f06ac0 WatchSource:0}: Error finding container 3b9b1238368d96865a6415c0beccc7d4078f7153467ecaf602faed18c9f06ac0: Status 404 returned error can't find the container with id 3b9b1238368d96865a6415c0beccc7d4078f7153467ecaf602faed18c9f06ac0
Sep 11 18:22:09.607501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:09.607467    2561 generic.go:356] "Generic (PLEG): container finished" podID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerID="812f41aa1a00b7b9f3c80b9c99aa84cd5d95d0a7980a85619afac4c65878b1ee" exitCode=0
Sep 11 18:22:09.607945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:09.607508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g" event={"ID":"478c2734-c9a4-47c6-8caf-3b3f0f29ba36","Type":"ContainerDied","Data":"812f41aa1a00b7b9f3c80b9c99aa84cd5d95d0a7980a85619afac4c65878b1ee"}
Sep 11 18:22:09.607945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:09.607543    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g" event={"ID":"478c2734-c9a4-47c6-8caf-3b3f0f29ba36","Type":"ContainerStarted","Data":"3b9b1238368d96865a6415c0beccc7d4078f7153467ecaf602faed18c9f06ac0"}
Sep 11 18:22:10.620132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:10.620098    2561 generic.go:356] "Generic (PLEG): container finished" podID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerID="253fc5a3ed35e869f0013f9f4cfcbfb9e62672a41b59138f564eeb0b9600748f" exitCode=0
Sep 11 18:22:10.620540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:10.620175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g" event={"ID":"478c2734-c9a4-47c6-8caf-3b3f0f29ba36","Type":"ContainerDied","Data":"253fc5a3ed35e869f0013f9f4cfcbfb9e62672a41b59138f564eeb0b9600748f"}
Sep 11 18:22:11.627499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:11.627465    2561 generic.go:356] "Generic (PLEG): container finished" podID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerID="d173fca0844f382da86db13b2a4182114564b38f454a910fb18c034727841efe" exitCode=0
Sep 11 18:22:11.627892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:11.627554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g" event={"ID":"478c2734-c9a4-47c6-8caf-3b3f0f29ba36","Type":"ContainerDied","Data":"d173fca0844f382da86db13b2a4182114564b38f454a910fb18c034727841efe"}
Sep 11 18:22:12.766637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.766613    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:12.783223 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.783199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-util\") pod \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") "
Sep 11 18:22:12.783374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.783297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm7ql\" (UniqueName: \"kubernetes.io/projected/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-kube-api-access-qm7ql\") pod \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") "
Sep 11 18:22:12.783471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.783450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-bundle\") pod \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\" (UID: \"478c2734-c9a4-47c6-8caf-3b3f0f29ba36\") "
Sep 11 18:22:12.784065 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.784035    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-bundle" (OuterVolumeSpecName: "bundle") pod "478c2734-c9a4-47c6-8caf-3b3f0f29ba36" (UID: "478c2734-c9a4-47c6-8caf-3b3f0f29ba36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:22:12.785634 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.785604    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-kube-api-access-qm7ql" (OuterVolumeSpecName: "kube-api-access-qm7ql") pod "478c2734-c9a4-47c6-8caf-3b3f0f29ba36" (UID: "478c2734-c9a4-47c6-8caf-3b3f0f29ba36"). InnerVolumeSpecName "kube-api-access-qm7ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:22:12.791920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.791893    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-util" (OuterVolumeSpecName: "util") pod "478c2734-c9a4-47c6-8caf-3b3f0f29ba36" (UID: "478c2734-c9a4-47c6-8caf-3b3f0f29ba36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:22:12.884856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.884773    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm7ql\" (UniqueName: \"kubernetes.io/projected/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-kube-api-access-qm7ql\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:22:12.884856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.884800    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:22:12.884856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:12.884814    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c2734-c9a4-47c6-8caf-3b3f0f29ba36-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:22:13.638749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:13.638710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g" event={"ID":"478c2734-c9a4-47c6-8caf-3b3f0f29ba36","Type":"ContainerDied","Data":"3b9b1238368d96865a6415c0beccc7d4078f7153467ecaf602faed18c9f06ac0"}
Sep 11 18:22:13.638918 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:13.638762    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b9b1238368d96865a6415c0beccc7d4078f7153467ecaf602faed18c9f06ac0"
Sep 11 18:22:13.638918 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:13.638768    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbx2g"
Sep 11 18:22:24.375428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375374    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"]
Sep 11 18:22:24.375821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375798    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="pull"
Sep 11 18:22:24.375821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375810    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="pull"
Sep 11 18:22:24.375890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375823    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="util"
Sep 11 18:22:24.375890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375830    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="util"
Sep 11 18:22:24.375890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375852    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="extract"
Sep 11 18:22:24.375890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375858    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="extract"
Sep 11 18:22:24.376012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.375919    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="478c2734-c9a4-47c6-8caf-3b3f0f29ba36" containerName="extract"
Sep 11 18:22:24.378281 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.378260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.380538 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.380517    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:22:24.381487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.381471    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drtxq\""
Sep 11 18:22:24.381550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.381491    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:22:24.391711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.391686    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"]
Sep 11 18:22:24.402125 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.402088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:24.467867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.467832    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"]
Sep 11 18:22:24.470046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.470026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.472548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.472527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 18:22:24.472548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.472542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 18:22:24.472694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.472558    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 18:22:24.472694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.472638    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tf62c\""
Sep 11 18:22:24.480692 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.480669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"]
Sep 11 18:22:24.486893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.486872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.486993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.486951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcvc\" (UniqueName: \"kubernetes.io/projected/64e2c240-4ec7-4adc-ba59-67db2b1438e8-kube-api-access-5tcvc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.486993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.486978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.587905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.587872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8e54db-c4fb-4308-93bc-ebb90571256a-metrics-cert\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.588087 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.587921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a8e54db-c4fb-4308-93bc-ebb90571256a-manager-config\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.588087 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.587951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.588087 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.588011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcvc\" (UniqueName: \"kubernetes.io/projected/64e2c240-4ec7-4adc-ba59-67db2b1438e8-kube-api-access-5tcvc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.588248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.588132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8e54db-c4fb-4308-93bc-ebb90571256a-cert\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.588248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.588180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.588248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.588227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92drg\" (UniqueName: \"kubernetes.io/projected/5a8e54db-c4fb-4308-93bc-ebb90571256a-kube-api-access-92drg\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.588406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.588346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.588526 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.588508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.604353 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.604323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcvc\" (UniqueName: \"kubernetes.io/projected/64e2c240-4ec7-4adc-ba59-67db2b1438e8-kube-api-access-5tcvc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.687456 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.687367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:24.688625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.688603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8e54db-c4fb-4308-93bc-ebb90571256a-metrics-cert\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.688677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.688646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a8e54db-c4fb-4308-93bc-ebb90571256a-manager-config\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.688713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.688703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8e54db-c4fb-4308-93bc-ebb90571256a-cert\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.688759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.688733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92drg\" (UniqueName: \"kubernetes.io/projected/5a8e54db-c4fb-4308-93bc-ebb90571256a-kube-api-access-92drg\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.689464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.689441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a8e54db-c4fb-4308-93bc-ebb90571256a-manager-config\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.691398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.691373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8e54db-c4fb-4308-93bc-ebb90571256a-cert\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.691500 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.691417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8e54db-c4fb-4308-93bc-ebb90571256a-metrics-cert\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.700352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.700330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92drg\" (UniqueName: \"kubernetes.io/projected/5a8e54db-c4fb-4308-93bc-ebb90571256a-kube-api-access-92drg\") pod \"lws-controller-manager-68f8b56d64-vxl89\" (UID: \"5a8e54db-c4fb-4308-93bc-ebb90571256a\") " pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.780191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.780151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:24.973240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:24.973214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"]
Sep 11 18:22:24.975330 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:24.975287    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e2c240_4ec7_4adc_ba59_67db2b1438e8.slice/crio-62ecefbe1965051826fb6b17f8637578426272743acf184f767bcb17acf3f2c4 WatchSource:0}: Error finding container 62ecefbe1965051826fb6b17f8637578426272743acf184f767bcb17acf3f2c4: Status 404 returned error can't find the container with id 62ecefbe1965051826fb6b17f8637578426272743acf184f767bcb17acf3f2c4
Sep 11 18:22:25.053609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.053461    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"]
Sep 11 18:22:25.056163 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:25.056135    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8e54db_c4fb_4308_93bc_ebb90571256a.slice/crio-c6900d627b73a5bc055348b5d2930e768095c4b7df80bcc2433ca67495fe0531 WatchSource:0}: Error finding container c6900d627b73a5bc055348b5d2930e768095c4b7df80bcc2433ca67495fe0531: Status 404 returned error can't find the container with id c6900d627b73a5bc055348b5d2930e768095c4b7df80bcc2433ca67495fe0531
Sep 11 18:22:25.596250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.596216    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"]
Sep 11 18:22:25.599148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.599124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.604588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.603155    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 18:22:25.604588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.603464    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 18:22:25.604588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.603782    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 18:22:25.604588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.603957    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8779c\""
Sep 11 18:22:25.604588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.604129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 18:22:25.620329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.620288    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"]
Sep 11 18:22:25.698973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.698941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e45ff82-713b-4c61-afc9-1033182f542e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.699138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.699001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e45ff82-713b-4c61-afc9-1033182f542e-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.699138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.699025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e45ff82-713b-4c61-afc9-1033182f542e-manifests\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.699138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.699121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e45ff82-713b-4c61-afc9-1033182f542e-tmp\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.699259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.699197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5xnz\" (UniqueName: \"kubernetes.io/projected/1e45ff82-713b-4c61-afc9-1033182f542e-kube-api-access-w5xnz\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.704405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.704371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89" event={"ID":"5a8e54db-c4fb-4308-93bc-ebb90571256a","Type":"ContainerStarted","Data":"c6900d627b73a5bc055348b5d2930e768095c4b7df80bcc2433ca67495fe0531"}
Sep 11 18:22:25.705868 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.705843    2561 generic.go:356] "Generic (PLEG): container finished" podID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerID="9eaa1cc1686642f954bc6dc729d0886aecdabf4754529677a3611d2b72267beb" exitCode=0
Sep 11 18:22:25.705976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.705906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg" event={"ID":"64e2c240-4ec7-4adc-ba59-67db2b1438e8","Type":"ContainerDied","Data":"9eaa1cc1686642f954bc6dc729d0886aecdabf4754529677a3611d2b72267beb"}
Sep 11 18:22:25.705976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.705944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg" event={"ID":"64e2c240-4ec7-4adc-ba59-67db2b1438e8","Type":"ContainerStarted","Data":"62ecefbe1965051826fb6b17f8637578426272743acf184f767bcb17acf3f2c4"}
Sep 11 18:22:25.800351 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.800294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e45ff82-713b-4c61-afc9-1033182f542e-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.800550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.800367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e45ff82-713b-4c61-afc9-1033182f542e-manifests\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.800550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.800429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e45ff82-713b-4c61-afc9-1033182f542e-tmp\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.800550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.800493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5xnz\" (UniqueName: \"kubernetes.io/projected/1e45ff82-713b-4c61-afc9-1033182f542e-kube-api-access-w5xnz\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.800550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.800532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e45ff82-713b-4c61-afc9-1033182f542e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.801053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.801009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e45ff82-713b-4c61-afc9-1033182f542e-manifests\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.803201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.803141    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e45ff82-713b-4c61-afc9-1033182f542e-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.803201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.803156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e45ff82-713b-4c61-afc9-1033182f542e-tmp\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.803201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.803163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e45ff82-713b-4c61-afc9-1033182f542e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.812285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.812236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5xnz\" (UniqueName: \"kubernetes.io/projected/1e45ff82-713b-4c61-afc9-1033182f542e-kube-api-access-w5xnz\") pod \"opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd\" (UID: \"1e45ff82-713b-4c61-afc9-1033182f542e\") " pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:25.923805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:25.923727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:26.069248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:26.069199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:26.176131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:26.176053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:26.237934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:26.237911    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"]
Sep 11 18:22:26.249902 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:26.249873    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e45ff82_713b_4c61_afc9_1033182f542e.slice/crio-54267b41e273dd8b6f2e0505d7b769c4d7ef2975dc2ca20f99e8499d286d0902 WatchSource:0}: Error finding container 54267b41e273dd8b6f2e0505d7b769c4d7ef2975dc2ca20f99e8499d286d0902: Status 404 returned error can't find the container with id 54267b41e273dd8b6f2e0505d7b769c4d7ef2975dc2ca20f99e8499d286d0902
Sep 11 18:22:26.286530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:26.286485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:26.719151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:26.719122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd" event={"ID":"1e45ff82-713b-4c61-afc9-1033182f542e","Type":"ContainerStarted","Data":"54267b41e273dd8b6f2e0505d7b769c4d7ef2975dc2ca20f99e8499d286d0902"}
Sep 11 18:22:27.727670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:27.727623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89" event={"ID":"5a8e54db-c4fb-4308-93bc-ebb90571256a","Type":"ContainerStarted","Data":"c557e6f22300819d57503a036ff8d6c5f3774d272a99c2404ebac0c113ba32a4"}
Sep 11 18:22:27.728136 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:27.727740    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:27.729851 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:27.729815    2561 generic.go:356] "Generic (PLEG): container finished" podID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerID="08c08a24d39a944b2cbd5dc4407e0c6e4e02ed37f9d513569b792ad502ddef3a" exitCode=0
Sep 11 18:22:27.730014 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:27.729866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg" event={"ID":"64e2c240-4ec7-4adc-ba59-67db2b1438e8","Type":"ContainerDied","Data":"08c08a24d39a944b2cbd5dc4407e0c6e4e02ed37f9d513569b792ad502ddef3a"}
Sep 11 18:22:27.747228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:27.746995    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89" podStartSLOduration=2.16248683 podStartE2EDuration="3.746975027s" totalImagesPullingTime="1.584488197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:27.745348307 +0000 UTC m=+390.320451776" watchObservedRunningTime="2026-09-11 18:22:27.746975027 +0000 UTC m=+390.322078498"
Sep 11 18:22:28.738065 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:28.738018    2561 generic.go:356] "Generic (PLEG): container finished" podID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerID="a9a495a0a14f7637b096879b67118f31c34e191eb0bda0ef96d0fc8a48807ca2" exitCode=0
Sep 11 18:22:28.738569 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:28.738101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg" event={"ID":"64e2c240-4ec7-4adc-ba59-67db2b1438e8","Type":"ContainerDied","Data":"a9a495a0a14f7637b096879b67118f31c34e191eb0bda0ef96d0fc8a48807ca2"}
Sep 11 18:22:29.744900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.744804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd" event={"ID":"1e45ff82-713b-4c61-afc9-1033182f542e","Type":"ContainerStarted","Data":"900737794f9a706e7b79826e0b1648bdc342f336d4356f72fe0c37fa488c558b"}
Sep 11 18:22:29.877879 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.877850    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:29.942552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.942519    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tcvc\" (UniqueName: \"kubernetes.io/projected/64e2c240-4ec7-4adc-ba59-67db2b1438e8-kube-api-access-5tcvc\") pod \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") "
Sep 11 18:22:29.942744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.942610    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-bundle\") pod \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") "
Sep 11 18:22:29.942744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.942652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-util\") pod \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\" (UID: \"64e2c240-4ec7-4adc-ba59-67db2b1438e8\") "
Sep 11 18:22:29.943391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.943363    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-bundle" (OuterVolumeSpecName: "bundle") pod "64e2c240-4ec7-4adc-ba59-67db2b1438e8" (UID: "64e2c240-4ec7-4adc-ba59-67db2b1438e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:22:29.944763 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.944741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e2c240-4ec7-4adc-ba59-67db2b1438e8-kube-api-access-5tcvc" (OuterVolumeSpecName: "kube-api-access-5tcvc") pod "64e2c240-4ec7-4adc-ba59-67db2b1438e8" (UID: "64e2c240-4ec7-4adc-ba59-67db2b1438e8"). InnerVolumeSpecName "kube-api-access-5tcvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:22:29.948527 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:29.948502    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-util" (OuterVolumeSpecName: "util") pod "64e2c240-4ec7-4adc-ba59-67db2b1438e8" (UID: "64e2c240-4ec7-4adc-ba59-67db2b1438e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:22:30.044234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.044183    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tcvc\" (UniqueName: \"kubernetes.io/projected/64e2c240-4ec7-4adc-ba59-67db2b1438e8-kube-api-access-5tcvc\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:22:30.044234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.044220    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:22:30.044234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.044231    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64e2c240-4ec7-4adc-ba59-67db2b1438e8-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:22:30.751793 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.751739    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg"
Sep 11 18:22:30.751793 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.751761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0992bg" event={"ID":"64e2c240-4ec7-4adc-ba59-67db2b1438e8","Type":"ContainerDied","Data":"62ecefbe1965051826fb6b17f8637578426272743acf184f767bcb17acf3f2c4"}
Sep 11 18:22:30.752264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.751817    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62ecefbe1965051826fb6b17f8637578426272743acf184f767bcb17acf3f2c4"
Sep 11 18:22:30.753569 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.753545    2561 generic.go:356] "Generic (PLEG): container finished" podID="1e45ff82-713b-4c61-afc9-1033182f542e" containerID="900737794f9a706e7b79826e0b1648bdc342f336d4356f72fe0c37fa488c558b" exitCode=0
Sep 11 18:22:30.753681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:30.753622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd" event={"ID":"1e45ff82-713b-4c61-afc9-1033182f542e","Type":"ContainerDied","Data":"900737794f9a706e7b79826e0b1648bdc342f336d4356f72fe0c37fa488c558b"}
Sep 11 18:22:31.761141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:31.761099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd" event={"ID":"1e45ff82-713b-4c61-afc9-1033182f542e","Type":"ContainerStarted","Data":"23ec502bb711a4ae2f0463b33cdb46f4e7059c7a15de92cb2bd16a5087689998"}
Sep 11 18:22:31.761559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:31.761233    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:31.785787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:31.785726    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd" podStartSLOduration=2.1634502429999998 podStartE2EDuration="6.785707415s" totalImagesPullingTime="3.474404056s" totalInitContainerRuntime="1.147853116s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:31.784045755 +0000 UTC m=+394.359149253" watchObservedRunningTime="2026-09-11 18:22:31.785707415 +0000 UTC m=+394.360810939"
Sep 11 18:22:37.538213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:37.538169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:37.591472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:37.591441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:38.740639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:38.740604    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68f8b56d64-vxl89"
Sep 11 18:22:42.769414 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:42.769383    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd"
Sep 11 18:22:45.486711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:45.486672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:45.580054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:45.580025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:45.798536 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:45.798495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:45.894720 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:45.894690    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:47.058279 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:47.058244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:47.154945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:47.154911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:48.024469 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:48.024423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:49.811361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:49.811322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:49.913320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:49.913250    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:51.508842 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:51.508805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:51.622613 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:51.622581    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:52.148660 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.148627    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"]
Sep 11 18:22:52.148989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.148977    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="pull"
Sep 11 18:22:52.149044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.148991    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="pull"
Sep 11 18:22:52.149044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.149000    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="util"
Sep 11 18:22:52.149044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.149007    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="util"
Sep 11 18:22:52.149044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.149017    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="extract"
Sep 11 18:22:52.149044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.149023    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="extract"
Sep 11 18:22:52.149214 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.149091    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e2c240-4ec7-4adc-ba59-67db2b1438e8" containerName="extract"
Sep 11 18:22:52.151044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.151024    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.153744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.153720    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 18:22:52.153874 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.153779    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 18:22:52.153874 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.153843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hl7lm\""
Sep 11 18:22:52.153874 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.153849    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 18:22:52.162251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.162218    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"]
Sep 11 18:22:52.181636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.181600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:52.234166 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlc87\" (UniqueName: \"kubernetes.io/projected/161d95f0-b11f-4975-a65c-2a21c4d5df4a-kube-api-access-vlc87\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.234784 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.234469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.335772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.335739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.335968 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.335872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.335968 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.335955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.335985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlc87\" (UniqueName: \"kubernetes.io/projected/161d95f0-b11f-4975-a65c-2a21c4d5df4a-kube-api-access-vlc87\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336716 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336851 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.336973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.336953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.338347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.338325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.338633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.338618    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.344221 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.344199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161d95f0-b11f-4975-a65c-2a21c4d5df4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.344470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.344451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlc87\" (UniqueName: \"kubernetes.io/projected/161d95f0-b11f-4975-a65c-2a21c4d5df4a-kube-api-access-vlc87\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj\" (UID: \"161d95f0-b11f-4975-a65c-2a21c4d5df4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.381853 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.381824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:52.463600 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.463507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:52.685563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.685523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:52.744768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.744742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"]
Sep 11 18:22:52.746826 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:52.746798    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161d95f0_b11f_4975_a65c_2a21c4d5df4a.slice/crio-5c58632a43e760a90fa708251e6467539abb159b81eaa84211ee42cc997f681b WatchSource:0}: Error finding container 5c58632a43e760a90fa708251e6467539abb159b81eaa84211ee42cc997f681b: Status 404 returned error can't find the container with id 5c58632a43e760a90fa708251e6467539abb159b81eaa84211ee42cc997f681b
Sep 11 18:22:52.874543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:52.874500    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj" event={"ID":"161d95f0-b11f-4975-a65c-2a21c4d5df4a","Type":"ContainerStarted","Data":"5c58632a43e760a90fa708251e6467539abb159b81eaa84211ee42cc997f681b"}
Sep 11 18:22:53.619113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:53.619062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:55.120998 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:55.120956    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:22:55.121284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:55.121042    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:22:55.121284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:55.121072    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:22:55.893784 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:55.893741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj" event={"ID":"161d95f0-b11f-4975-a65c-2a21c4d5df4a","Type":"ContainerStarted","Data":"35ce59946c741973e9f97eb87584544c9e7cf9b0371c9a863adca2f17616907a"}
Sep 11 18:22:55.914665 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:55.914613    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj" podStartSLOduration=1.542888007 podStartE2EDuration="3.914595312s" totalImagesPullingTime="2.371707305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:22:55.912389688 +0000 UTC m=+418.487493147" watchObservedRunningTime="2026-09-11 18:22:55.914595312 +0000 UTC m=+418.489698850"
Sep 11 18:22:56.463840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.463799    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:56.468750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.468723    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:56.855842 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.855799    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xq5lv"]
Sep 11 18:22:56.866473 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.866440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:56.869232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.869174    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 18:22:56.869232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.869179    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hwlbf\""
Sep 11 18:22:56.870221 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.870193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xq5lv"]
Sep 11 18:22:56.898489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.898462    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:56.899866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.899841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj"
Sep 11 18:22:56.916460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.916436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:56.980933 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.980885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e53fbd-d31d-4e6c-bdad-e78750064e70-cert\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:56.981139 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:56.981017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw9wt\" (UniqueName: \"kubernetes.io/projected/d2e53fbd-d31d-4e6c-bdad-e78750064e70-kube-api-access-nw9wt\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.018138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.018095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:57.081759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.081723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e53fbd-d31d-4e6c-bdad-e78750064e70-cert\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.081981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.081781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw9wt\" (UniqueName: \"kubernetes.io/projected/d2e53fbd-d31d-4e6c-bdad-e78750064e70-kube-api-access-nw9wt\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.081981 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:22:57.081912    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 18:22:57.082063 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:22:57.082005    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e53fbd-d31d-4e6c-bdad-e78750064e70-cert podName:d2e53fbd-d31d-4e6c-bdad-e78750064e70 nodeName:}" failed. No retries permitted until 2026-09-11 18:22:57.581980874 +0000 UTC m=+420.157084338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2e53fbd-d31d-4e6c-bdad-e78750064e70-cert") pod "odh-model-controller-7998c67dc4-xq5lv" (UID: "d2e53fbd-d31d-4e6c-bdad-e78750064e70") : secret "odh-model-controller-webhook-cert" not found
Sep 11 18:22:57.094054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.094019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw9wt\" (UniqueName: \"kubernetes.io/projected/d2e53fbd-d31d-4e6c-bdad-e78750064e70-kube-api-access-nw9wt\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.120746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.120668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:57.451832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.451730    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:57.545834 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.545791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:57.550861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.550833    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rsfn4"]
Sep 11 18:22:57.553438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.553419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.555768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.555750    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2l4vd\""
Sep 11 18:22:57.555977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.555962    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 18:22:57.565865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.565841    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rsfn4"]
Sep 11 18:22:57.587426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.587398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6e8d5e-3d02-4774-9ad0-eddcee4b2943-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsfn4\" (UID: \"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.587580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.587446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e53fbd-d31d-4e6c-bdad-e78750064e70-cert\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.587580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.587564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6ld\" (UniqueName: \"kubernetes.io/projected/fb6e8d5e-3d02-4774-9ad0-eddcee4b2943-kube-api-access-4t6ld\") pod \"model-serving-api-54d89bd5fc-rsfn4\" (UID: \"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.590056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.590027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e53fbd-d31d-4e6c-bdad-e78750064e70-cert\") pod \"odh-model-controller-7998c67dc4-xq5lv\" (UID: \"d2e53fbd-d31d-4e6c-bdad-e78750064e70\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.606121 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.606086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:22:57.688959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.688922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6e8d5e-3d02-4774-9ad0-eddcee4b2943-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsfn4\" (UID: \"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.689173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.689019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6ld\" (UniqueName: \"kubernetes.io/projected/fb6e8d5e-3d02-4774-9ad0-eddcee4b2943-kube-api-access-4t6ld\") pod \"model-serving-api-54d89bd5fc-rsfn4\" (UID: \"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.691543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.691521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6e8d5e-3d02-4774-9ad0-eddcee4b2943-tls-certs\") pod \"model-serving-api-54d89bd5fc-rsfn4\" (UID: \"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.696605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.696585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6ld\" (UniqueName: \"kubernetes.io/projected/fb6e8d5e-3d02-4774-9ad0-eddcee4b2943-kube-api-access-4t6ld\") pod \"model-serving-api-54d89bd5fc-rsfn4\" (UID: \"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943\") " pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:57.782031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.781996    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hwlbf\""
Sep 11 18:22:57.790051 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.790009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:22:57.868701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.868640    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2l4vd\""
Sep 11 18:22:57.876902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:57.876841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:22:58.066524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:58.066488    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xq5lv"]
Sep 11 18:22:58.068369 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:58.068342    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e53fbd_d31d_4e6c_bdad_e78750064e70.slice/crio-18195d8c09f9af77b1c9574d6f208b82964bf47304560f89d556db8a50db8517 WatchSource:0}: Error finding container 18195d8c09f9af77b1c9574d6f208b82964bf47304560f89d556db8a50db8517: Status 404 returned error can't find the container with id 18195d8c09f9af77b1c9574d6f208b82964bf47304560f89d556db8a50db8517
Sep 11 18:22:58.153094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:58.153069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rsfn4"]
Sep 11 18:22:58.155011 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:22:58.154980    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6e8d5e_3d02_4774_9ad0_eddcee4b2943.slice/crio-5bd9cc698086493b2e6c137a335b7c8fab79780fb5c4600595b7e14e579e726b WatchSource:0}: Error finding container 5bd9cc698086493b2e6c137a335b7c8fab79780fb5c4600595b7e14e579e726b: Status 404 returned error can't find the container with id 5bd9cc698086493b2e6c137a335b7c8fab79780fb5c4600595b7e14e579e726b
Sep 11 18:22:58.919081 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:58.919034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv" event={"ID":"d2e53fbd-d31d-4e6c-bdad-e78750064e70","Type":"ContainerStarted","Data":"18195d8c09f9af77b1c9574d6f208b82964bf47304560f89d556db8a50db8517"}
Sep 11 18:22:58.921125 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:22:58.921061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4" event={"ID":"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943","Type":"ContainerStarted","Data":"5bd9cc698086493b2e6c137a335b7c8fab79780fb5c4600595b7e14e579e726b"}
Sep 11 18:23:02.947783 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:02.947730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4" event={"ID":"fb6e8d5e-3d02-4774-9ad0-eddcee4b2943","Type":"ContainerStarted","Data":"1c5d6e42079f22d8d35fa109f87e84d3cc782ee7e982c0272dd96aa79161da61"}
Sep 11 18:23:02.948323 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:02.947809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:23:02.949525 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:02.949503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv" event={"ID":"d2e53fbd-d31d-4e6c-bdad-e78750064e70","Type":"ContainerStarted","Data":"63db86f3d849bc16ddcd79dcfca4d0580a844750feb38597aa6594910ba36699"}
Sep 11 18:23:02.949638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:02.949544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:23:02.965324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:02.965267    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4" podStartSLOduration=2.005492814 podStartE2EDuration="5.965252554s" totalImagesPullingTime="3.95975974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:02.96363474 +0000 UTC m=+425.538738206" watchObservedRunningTime="2026-09-11 18:23:02.965252554 +0000 UTC m=+425.540356042"
Sep 11 18:23:02.978107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:02.978058    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv" podStartSLOduration=2.8896850499999998 podStartE2EDuration="6.978044259s" totalImagesPullingTime="4.088359209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:02.9772924 +0000 UTC m=+425.552395875" watchObservedRunningTime="2026-09-11 18:23:02.978044259 +0000 UTC m=+425.553147726"
Sep 11 18:23:07.138635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.138590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:07.183062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.183019    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"]
Sep 11 18:23:07.187191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.187165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.190670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.190647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 18:23:07.190807 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.190785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lmnrp\""
Sep 11 18:23:07.199682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.199656    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"]
Sep 11 18:23:07.225918 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.225888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:07.285357 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.285293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cll8p\" (UniqueName: \"kubernetes.io/projected/6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7-kube-api-access-cll8p\") pod \"kserve-controller-manager-d6f4b65b8-8gpx7\" (UID: \"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.285531 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.285451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7-cert\") pod \"kserve-controller-manager-d6f4b65b8-8gpx7\" (UID: \"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.352627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.352591    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:07.386643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.386606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cll8p\" (UniqueName: \"kubernetes.io/projected/6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7-kube-api-access-cll8p\") pod \"kserve-controller-manager-d6f4b65b8-8gpx7\" (UID: \"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.386829 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.386690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7-cert\") pod \"kserve-controller-manager-d6f4b65b8-8gpx7\" (UID: \"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.389208 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.389139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7-cert\") pod \"kserve-controller-manager-d6f4b65b8-8gpx7\" (UID: \"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.395471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.395444    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cll8p\" (UniqueName: \"kubernetes.io/projected/6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7-kube-api-access-cll8p\") pod \"kserve-controller-manager-d6f4b65b8-8gpx7\" (UID: \"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.474550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.474512    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:07.499977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.499949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:07.781690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.781664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"]
Sep 11 18:23:07.783876 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:23:07.783842    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8ee13a_eb07_44bb_a8a8_e56ce2f196b7.slice/crio-cccb67050cac13aada8ab7c37952ac062095dc189f37bca749b0bc27a67cba1d WatchSource:0}: Error finding container cccb67050cac13aada8ab7c37952ac062095dc189f37bca749b0bc27a67cba1d: Status 404 returned error can't find the container with id cccb67050cac13aada8ab7c37952ac062095dc189f37bca749b0bc27a67cba1d
Sep 11 18:23:07.977029 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:07.976991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7" event={"ID":"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7","Type":"ContainerStarted","Data":"cccb67050cac13aada8ab7c37952ac062095dc189f37bca749b0bc27a67cba1d"}
Sep 11 18:23:08.425625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:08.425590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:08.575019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:08.574974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:08.661767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:08.661713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:09.990535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:09.990484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7" event={"ID":"6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7","Type":"ContainerStarted","Data":"ac6c59b320536baf5d3f0383ab37ac1f46d193b1be8f8254c44e42fe6c496ef8"}
Sep 11 18:23:09.990983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:09.990558    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:10.009908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:10.009853    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7" podStartSLOduration=0.908500423 podStartE2EDuration="3.009838696s" totalImagesPullingTime="2.101338273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:23:10.007430541 +0000 UTC m=+432.582534012" watchObservedRunningTime="2026-09-11 18:23:10.009838696 +0000 UTC m=+432.584942164"
Sep 11 18:23:13.956988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:13.956958    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xq5lv"
Sep 11 18:23:13.958982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:13.958960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rsfn4"
Sep 11 18:23:41.000960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:41.000926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gpx7"
Sep 11 18:23:58.137270 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:58.137233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:23:58.229446 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:23:58.229410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:01.726325 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.726260    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"]
Sep 11 18:24:01.729715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.729687    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"]
Sep 11 18:24:01.729850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.729798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.732866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.732499    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:24:01.732866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.732575    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:24:01.732866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.732505    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drtxq\""
Sep 11 18:24:01.815434 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.815390    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"]
Sep 11 18:24:01.818126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.818104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.827401 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.827380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"]
Sep 11 18:24:01.896418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.896383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8kml\" (UniqueName: \"kubernetes.io/projected/f05723bd-d690-45e1-ab45-0d6e69435f60-kube-api-access-j8kml\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.896581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.896423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.896581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.896533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.896581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.896569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.896696 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.896597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.896696 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.896631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgpr7\" (UniqueName: \"kubernetes.io/projected/aa2bb518-7250-430c-a653-ea79b53715d2-kube-api-access-rgpr7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.920670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.920637    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"]
Sep 11 18:24:01.923537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.923521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:01.932281 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.932254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"]
Sep 11 18:24:01.997175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgpr7\" (UniqueName: \"kubernetes.io/projected/aa2bb518-7250-430c-a653-ea79b53715d2-kube-api-access-rgpr7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.997175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:01.997460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8kml\" (UniqueName: \"kubernetes.io/projected/f05723bd-d690-45e1-ab45-0d6e69435f60-kube-api-access-j8kml\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.997460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.997460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:01.997460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.997460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfg4s\" (UniqueName: \"kubernetes.io/projected/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-kube-api-access-mfg4s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:01.997460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.997821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.997821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.997821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:01.997821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:01.997979 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:01.997841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:02.005379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.005357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgpr7\" (UniqueName: \"kubernetes.io/projected/aa2bb518-7250-430c-a653-ea79b53715d2-kube-api-access-rgpr7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:02.005565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.005546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8kml\" (UniqueName: \"kubernetes.io/projected/f05723bd-d690-45e1-ab45-0d6e69435f60-kube-api-access-j8kml\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:02.028637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.028607    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"]
Sep 11 18:24:02.031649 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.031634    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.040062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.040040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"]
Sep 11 18:24:02.041012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.040996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:02.098884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.098854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.099005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.098925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfg4s\" (UniqueName: \"kubernetes.io/projected/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-kube-api-access-mfg4s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.099005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.098988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.099376 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.099353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.099460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.099382    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.108040 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.108009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfg4s\" (UniqueName: \"kubernetes.io/projected/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-kube-api-access-mfg4s\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.128730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.128698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:02.199894 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.199850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trt6r\" (UniqueName: \"kubernetes.io/projected/7045e7ff-c982-4908-90f7-9e45459874db-kube-api-access-trt6r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.200060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.199942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.200060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.200007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.233837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.233807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:02.301036 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.300997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.301179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.301129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trt6r\" (UniqueName: \"kubernetes.io/projected/7045e7ff-c982-4908-90f7-9e45459874db-kube-api-access-trt6r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.301252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.301174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.301487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.301443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.301615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.301534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.308956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.308928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trt6r\" (UniqueName: \"kubernetes.io/projected/7045e7ff-c982-4908-90f7-9e45459874db-kube-api-access-trt6r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.315412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.315385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"]
Sep 11 18:24:02.316239 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:02.316202    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05723bd_d690_45e1_ab45_0d6e69435f60.slice/crio-72fcfdbb48f65bd2ca5cc69d0e8189835309429eca7d659b927059a1320e3126 WatchSource:0}: Error finding container 72fcfdbb48f65bd2ca5cc69d0e8189835309429eca7d659b927059a1320e3126: Status 404 returned error can't find the container with id 72fcfdbb48f65bd2ca5cc69d0e8189835309429eca7d659b927059a1320e3126
Sep 11 18:24:02.342913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.342892    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:02.403942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.403846    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"]
Sep 11 18:24:02.409382 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:02.409023    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2bb518_7250_430c_a653_ea79b53715d2.slice/crio-a8db083c568cd042d5ed8df7004b7e7fb44e0b4f3b6ca6f581fd03dadff827ad WatchSource:0}: Error finding container a8db083c568cd042d5ed8df7004b7e7fb44e0b4f3b6ca6f581fd03dadff827ad: Status 404 returned error can't find the container with id a8db083c568cd042d5ed8df7004b7e7fb44e0b4f3b6ca6f581fd03dadff827ad
Sep 11 18:24:02.506850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.506828    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"]
Sep 11 18:24:02.508484 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:02.508451    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80b5a5a_9d3e_4ab9_9de1_a0f3641f541c.slice/crio-938fa45dcbd5bf3583004a5e08776ca7c70ea232f7177e6f99c5d1baf189fe4e WatchSource:0}: Error finding container 938fa45dcbd5bf3583004a5e08776ca7c70ea232f7177e6f99c5d1baf189fe4e: Status 404 returned error can't find the container with id 938fa45dcbd5bf3583004a5e08776ca7c70ea232f7177e6f99c5d1baf189fe4e
Sep 11 18:24:02.624762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:02.624738    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"]
Sep 11 18:24:02.655084 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:02.655051    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7045e7ff_c982_4908_90f7_9e45459874db.slice/crio-a79112739dd7c96f9b5469e3c3b8034bca0a78e1f09e6dbc1d4869159eaeda12 WatchSource:0}: Error finding container a79112739dd7c96f9b5469e3c3b8034bca0a78e1f09e6dbc1d4869159eaeda12: Status 404 returned error can't find the container with id a79112739dd7c96f9b5469e3c3b8034bca0a78e1f09e6dbc1d4869159eaeda12
Sep 11 18:24:03.260482 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.260445    2561 generic.go:356] "Generic (PLEG): container finished" podID="7045e7ff-c982-4908-90f7-9e45459874db" containerID="0c8d73323de75923c935502846a7d22ca547f405855e006ee4930fd476de56e2" exitCode=0
Sep 11 18:24:03.260948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.260530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5" event={"ID":"7045e7ff-c982-4908-90f7-9e45459874db","Type":"ContainerDied","Data":"0c8d73323de75923c935502846a7d22ca547f405855e006ee4930fd476de56e2"}
Sep 11 18:24:03.260948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.260586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5" event={"ID":"7045e7ff-c982-4908-90f7-9e45459874db","Type":"ContainerStarted","Data":"a79112739dd7c96f9b5469e3c3b8034bca0a78e1f09e6dbc1d4869159eaeda12"}
Sep 11 18:24:03.262352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.262322    2561 generic.go:356] "Generic (PLEG): container finished" podID="aa2bb518-7250-430c-a653-ea79b53715d2" containerID="ecd17da5f6d6090bc1b9850e8eb255156857140d03e71bc2f03ec0b094c28308" exitCode=0
Sep 11 18:24:03.262477 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.262406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd" event={"ID":"aa2bb518-7250-430c-a653-ea79b53715d2","Type":"ContainerDied","Data":"ecd17da5f6d6090bc1b9850e8eb255156857140d03e71bc2f03ec0b094c28308"}
Sep 11 18:24:03.262477 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.262464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd" event={"ID":"aa2bb518-7250-430c-a653-ea79b53715d2","Type":"ContainerStarted","Data":"a8db083c568cd042d5ed8df7004b7e7fb44e0b4f3b6ca6f581fd03dadff827ad"}
Sep 11 18:24:03.264184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.264158    2561 generic.go:356] "Generic (PLEG): container finished" podID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerID="f811c925b37458a85c06ac4c9641706f5240b72293e99a13772e9dc2ea4f9ab0" exitCode=0
Sep 11 18:24:03.264290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.264235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz" event={"ID":"f05723bd-d690-45e1-ab45-0d6e69435f60","Type":"ContainerDied","Data":"f811c925b37458a85c06ac4c9641706f5240b72293e99a13772e9dc2ea4f9ab0"}
Sep 11 18:24:03.264290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.264267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz" event={"ID":"f05723bd-d690-45e1-ab45-0d6e69435f60","Type":"ContainerStarted","Data":"72fcfdbb48f65bd2ca5cc69d0e8189835309429eca7d659b927059a1320e3126"}
Sep 11 18:24:03.265989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.265970    2561 generic.go:356] "Generic (PLEG): container finished" podID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerID="b5ae500c3c5160f1852dd40fa55b5bfadcca7c024e26d589ac3ddf2738bf8aa6" exitCode=0
Sep 11 18:24:03.266076 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.266055    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9" event={"ID":"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c","Type":"ContainerDied","Data":"b5ae500c3c5160f1852dd40fa55b5bfadcca7c024e26d589ac3ddf2738bf8aa6"}
Sep 11 18:24:03.266140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:03.266102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9" event={"ID":"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c","Type":"ContainerStarted","Data":"938fa45dcbd5bf3583004a5e08776ca7c70ea232f7177e6f99c5d1baf189fe4e"}
Sep 11 18:24:04.274297 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:04.274262    2561 generic.go:356] "Generic (PLEG): container finished" podID="7045e7ff-c982-4908-90f7-9e45459874db" containerID="4e3e2b10e87cfdeb01c5d087916ecf0b81d9dc53f02c37df35d5bc5228e91d2a" exitCode=0
Sep 11 18:24:04.274723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:04.274345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5" event={"ID":"7045e7ff-c982-4908-90f7-9e45459874db","Type":"ContainerDied","Data":"4e3e2b10e87cfdeb01c5d087916ecf0b81d9dc53f02c37df35d5bc5228e91d2a"}
Sep 11 18:24:04.276358 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:04.276338    2561 generic.go:356] "Generic (PLEG): container finished" podID="aa2bb518-7250-430c-a653-ea79b53715d2" containerID="73acd2c2b02736249394ba5aad25096cb7028e9b05c009ce4097ede35599d9ab" exitCode=0
Sep 11 18:24:04.276449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:04.276421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd" event={"ID":"aa2bb518-7250-430c-a653-ea79b53715d2","Type":"ContainerDied","Data":"73acd2c2b02736249394ba5aad25096cb7028e9b05c009ce4097ede35599d9ab"}
Sep 11 18:24:04.278545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:04.278498    2561 generic.go:356] "Generic (PLEG): container finished" podID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerID="87f86a676d3baf36c2389ed5de4c71f176bd1e5b27819229a84a667e74dde334" exitCode=0
Sep 11 18:24:04.278724 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:04.278639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz" event={"ID":"f05723bd-d690-45e1-ab45-0d6e69435f60","Type":"ContainerDied","Data":"87f86a676d3baf36c2389ed5de4c71f176bd1e5b27819229a84a667e74dde334"}
Sep 11 18:24:05.286820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.286788    2561 generic.go:356] "Generic (PLEG): container finished" podID="7045e7ff-c982-4908-90f7-9e45459874db" containerID="8fd822aef8cca51d9e49fc146fbefa6802e77c41b9f7251f3c458ac0490992de" exitCode=0
Sep 11 18:24:05.287272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.286873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5" event={"ID":"7045e7ff-c982-4908-90f7-9e45459874db","Type":"ContainerDied","Data":"8fd822aef8cca51d9e49fc146fbefa6802e77c41b9f7251f3c458ac0490992de"}
Sep 11 18:24:05.288893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.288872    2561 generic.go:356] "Generic (PLEG): container finished" podID="aa2bb518-7250-430c-a653-ea79b53715d2" containerID="67ad851987c03478a73716bd8690ebb3bc26bd3a710b2ec376877e0039320174" exitCode=0
Sep 11 18:24:05.288980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.288949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd" event={"ID":"aa2bb518-7250-430c-a653-ea79b53715d2","Type":"ContainerDied","Data":"67ad851987c03478a73716bd8690ebb3bc26bd3a710b2ec376877e0039320174"}
Sep 11 18:24:05.291031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.291008    2561 generic.go:356] "Generic (PLEG): container finished" podID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerID="74ea02796efaf5140d76f97d7eb0e85f77906ef46fa14f15e140e1439cce99f9" exitCode=0
Sep 11 18:24:05.291160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.291080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz" event={"ID":"f05723bd-d690-45e1-ab45-0d6e69435f60","Type":"ContainerDied","Data":"74ea02796efaf5140d76f97d7eb0e85f77906ef46fa14f15e140e1439cce99f9"}
Sep 11 18:24:05.292844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.292823    2561 generic.go:356] "Generic (PLEG): container finished" podID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerID="eadac7b088d344ea8545505e807a222de243144769cb529cb37d38ae07794fa3" exitCode=0
Sep 11 18:24:05.292941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:05.292853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9" event={"ID":"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c","Type":"ContainerDied","Data":"eadac7b088d344ea8545505e807a222de243144769cb529cb37d38ae07794fa3"}
Sep 11 18:24:06.300236 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.300198    2561 generic.go:356] "Generic (PLEG): container finished" podID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerID="385e9582656a3c15a1c39989949e04ebcb7e8aef90683fdb95c3096c81e1797f" exitCode=0
Sep 11 18:24:06.300634 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.300285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9" event={"ID":"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c","Type":"ContainerDied","Data":"385e9582656a3c15a1c39989949e04ebcb7e8aef90683fdb95c3096c81e1797f"}
Sep 11 18:24:06.482189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.482158    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:06.485493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.485465    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:06.488876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.488856    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:06.644662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644558    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-bundle\") pod \"7045e7ff-c982-4908-90f7-9e45459874db\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") "
Sep 11 18:24:06.644662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-util\") pod \"f05723bd-d690-45e1-ab45-0d6e69435f60\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") "
Sep 11 18:24:06.644662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644638    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-util\") pod \"7045e7ff-c982-4908-90f7-9e45459874db\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") "
Sep 11 18:24:06.644965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trt6r\" (UniqueName: \"kubernetes.io/projected/7045e7ff-c982-4908-90f7-9e45459874db-kube-api-access-trt6r\") pod \"7045e7ff-c982-4908-90f7-9e45459874db\" (UID: \"7045e7ff-c982-4908-90f7-9e45459874db\") "
Sep 11 18:24:06.644965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644702    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-util\") pod \"aa2bb518-7250-430c-a653-ea79b53715d2\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") "
Sep 11 18:24:06.644965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-bundle\") pod \"f05723bd-d690-45e1-ab45-0d6e69435f60\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") "
Sep 11 18:24:06.644965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8kml\" (UniqueName: \"kubernetes.io/projected/f05723bd-d690-45e1-ab45-0d6e69435f60-kube-api-access-j8kml\") pod \"f05723bd-d690-45e1-ab45-0d6e69435f60\" (UID: \"f05723bd-d690-45e1-ab45-0d6e69435f60\") "
Sep 11 18:24:06.644965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644842    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgpr7\" (UniqueName: \"kubernetes.io/projected/aa2bb518-7250-430c-a653-ea79b53715d2-kube-api-access-rgpr7\") pod \"aa2bb518-7250-430c-a653-ea79b53715d2\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") "
Sep 11 18:24:06.644965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.644881    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-bundle\") pod \"aa2bb518-7250-430c-a653-ea79b53715d2\" (UID: \"aa2bb518-7250-430c-a653-ea79b53715d2\") "
Sep 11 18:24:06.645828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.645607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-bundle" (OuterVolumeSpecName: "bundle") pod "aa2bb518-7250-430c-a653-ea79b53715d2" (UID: "aa2bb518-7250-430c-a653-ea79b53715d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:06.646253 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.646220    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-bundle" (OuterVolumeSpecName: "bundle") pod "f05723bd-d690-45e1-ab45-0d6e69435f60" (UID: "f05723bd-d690-45e1-ab45-0d6e69435f60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:06.646425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.646259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-bundle" (OuterVolumeSpecName: "bundle") pod "7045e7ff-c982-4908-90f7-9e45459874db" (UID: "7045e7ff-c982-4908-90f7-9e45459874db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:06.647480 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.647452    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f05723bd-d690-45e1-ab45-0d6e69435f60-kube-api-access-j8kml" (OuterVolumeSpecName: "kube-api-access-j8kml") pod "f05723bd-d690-45e1-ab45-0d6e69435f60" (UID: "f05723bd-d690-45e1-ab45-0d6e69435f60"). InnerVolumeSpecName "kube-api-access-j8kml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:06.647576 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.647491    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7045e7ff-c982-4908-90f7-9e45459874db-kube-api-access-trt6r" (OuterVolumeSpecName: "kube-api-access-trt6r") pod "7045e7ff-c982-4908-90f7-9e45459874db" (UID: "7045e7ff-c982-4908-90f7-9e45459874db"). InnerVolumeSpecName "kube-api-access-trt6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:06.647742 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.647718    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2bb518-7250-430c-a653-ea79b53715d2-kube-api-access-rgpr7" (OuterVolumeSpecName: "kube-api-access-rgpr7") pod "aa2bb518-7250-430c-a653-ea79b53715d2" (UID: "aa2bb518-7250-430c-a653-ea79b53715d2"). InnerVolumeSpecName "kube-api-access-rgpr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:06.651250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.651219    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-util" (OuterVolumeSpecName: "util") pod "7045e7ff-c982-4908-90f7-9e45459874db" (UID: "7045e7ff-c982-4908-90f7-9e45459874db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:06.652018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.652001    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-util" (OuterVolumeSpecName: "util") pod "f05723bd-d690-45e1-ab45-0d6e69435f60" (UID: "f05723bd-d690-45e1-ab45-0d6e69435f60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:06.653484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.653458    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-util" (OuterVolumeSpecName: "util") pod "aa2bb518-7250-430c-a653-ea79b53715d2" (UID: "aa2bb518-7250-430c-a653-ea79b53715d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:06.745663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745622    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgpr7\" (UniqueName: \"kubernetes.io/projected/aa2bb518-7250-430c-a653-ea79b53715d2-kube-api-access-rgpr7\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745657    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745668    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745675    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745684    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7045e7ff-c982-4908-90f7-9e45459874db-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745693    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trt6r\" (UniqueName: \"kubernetes.io/projected/7045e7ff-c982-4908-90f7-9e45459874db-kube-api-access-trt6r\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745701    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa2bb518-7250-430c-a653-ea79b53715d2-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745709    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f05723bd-d690-45e1-ab45-0d6e69435f60-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:06.745931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:06.745717    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8kml\" (UniqueName: \"kubernetes.io/projected/f05723bd-d690-45e1-ab45-0d6e69435f60-kube-api-access-j8kml\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:07.307817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.307782    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5"
Sep 11 18:24:07.307817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.307793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvvwr5" event={"ID":"7045e7ff-c982-4908-90f7-9e45459874db","Type":"ContainerDied","Data":"a79112739dd7c96f9b5469e3c3b8034bca0a78e1f09e6dbc1d4869159eaeda12"}
Sep 11 18:24:07.308286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.307844    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a79112739dd7c96f9b5469e3c3b8034bca0a78e1f09e6dbc1d4869159eaeda12"
Sep 11 18:24:07.309877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.309854    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd"
Sep 11 18:24:07.309989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.309855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76gkpd" event={"ID":"aa2bb518-7250-430c-a653-ea79b53715d2","Type":"ContainerDied","Data":"a8db083c568cd042d5ed8df7004b7e7fb44e0b4f3b6ca6f581fd03dadff827ad"}
Sep 11 18:24:07.309989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.309966    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8db083c568cd042d5ed8df7004b7e7fb44e0b4f3b6ca6f581fd03dadff827ad"
Sep 11 18:24:07.311947 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.311931    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz"
Sep 11 18:24:07.312031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.311967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atv4zz" event={"ID":"f05723bd-d690-45e1-ab45-0d6e69435f60","Type":"ContainerDied","Data":"72fcfdbb48f65bd2ca5cc69d0e8189835309429eca7d659b927059a1320e3126"}
Sep 11 18:24:07.312031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.312005    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72fcfdbb48f65bd2ca5cc69d0e8189835309429eca7d659b927059a1320e3126"
Sep 11 18:24:07.429219 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.429196    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:07.554081 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.554052    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-util\") pod \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") "
Sep 11 18:24:07.554231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.554095    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-bundle\") pod \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") "
Sep 11 18:24:07.554231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.554116    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfg4s\" (UniqueName: \"kubernetes.io/projected/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-kube-api-access-mfg4s\") pod \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\" (UID: \"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c\") "
Sep 11 18:24:07.554603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.554583    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-bundle" (OuterVolumeSpecName: "bundle") pod "d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" (UID: "d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:07.556627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.556599    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-kube-api-access-mfg4s" (OuterVolumeSpecName: "kube-api-access-mfg4s") pod "d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" (UID: "d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c"). InnerVolumeSpecName "kube-api-access-mfg4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:07.560132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.560077    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-util" (OuterVolumeSpecName: "util") pod "d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" (UID: "d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:07.655823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.655789    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:07.655823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.655816    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:07.655823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:07.655825    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfg4s\" (UniqueName: \"kubernetes.io/projected/d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c-kube-api-access-mfg4s\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:08.189845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.189752    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96c4f7b6d-d8xth"]
Sep 11 18:24:08.190341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190323    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="util"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190345    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="util"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190359    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="pull"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190367    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="pull"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190378    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="extract"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190386    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="extract"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190399    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="extract"
Sep 11 18:24:08.190411 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190406    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="extract"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190419    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="util"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190426    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="util"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190442    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="pull"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190449    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="pull"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190469    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="util"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190476    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="util"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190484    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="pull"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190492    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="pull"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190505    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="util"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190512    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="util"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190520    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="extract"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190527    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="extract"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190536    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="extract"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190543    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="extract"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190558    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="pull"
Sep 11 18:24:08.190621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190566    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="pull"
Sep 11 18:24:08.191059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190656    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7045e7ff-c982-4908-90f7-9e45459874db" containerName="extract"
Sep 11 18:24:08.191059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190668    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f05723bd-d690-45e1-ab45-0d6e69435f60" containerName="extract"
Sep 11 18:24:08.191059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190677    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2bb518-7250-430c-a653-ea79b53715d2" containerName="extract"
Sep 11 18:24:08.191059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.190690    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c" containerName="extract"
Sep 11 18:24:08.193988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.193970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.209425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.209395    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96c4f7b6d-d8xth"]
Sep 11 18:24:08.310239 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.310206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:08.319441 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.319420    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9"
Sep 11 18:24:08.319584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.319416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65wms9" event={"ID":"d80b5a5a-9d3e-4ab9-9de1-a0f3641f541c","Type":"ContainerDied","Data":"938fa45dcbd5bf3583004a5e08776ca7c70ea232f7177e6f99c5d1baf189fe4e"}
Sep 11 18:24:08.319584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.319537    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="938fa45dcbd5bf3583004a5e08776ca7c70ea232f7177e6f99c5d1baf189fe4e"
Sep 11 18:24:08.362496 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-trusted-ca-bundle\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.362684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-console-config\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.362684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-oauth-serving-cert\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.362684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b456059a-f747-4a14-aad5-48cc46aade2a-console-serving-cert\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.362684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-service-ca\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.362684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b456059a-f747-4a14-aad5-48cc46aade2a-console-oauth-config\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.362864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.362700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnr5t\" (UniqueName: \"kubernetes.io/projected/b456059a-f747-4a14-aad5-48cc46aade2a-kube-api-access-dnr5t\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.403602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.403541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:08.463787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-console-config\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.463787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-oauth-serving-cert\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.463997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b456059a-f747-4a14-aad5-48cc46aade2a-console-serving-cert\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.463997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-service-ca\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.463997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b456059a-f747-4a14-aad5-48cc46aade2a-console-oauth-config\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.463997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnr5t\" (UniqueName: \"kubernetes.io/projected/b456059a-f747-4a14-aad5-48cc46aade2a-kube-api-access-dnr5t\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.463997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.463927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-trusted-ca-bundle\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.464632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.464602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-service-ca\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.464632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.464621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-console-config\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.464766 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.464637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-oauth-serving-cert\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.464831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.464814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b456059a-f747-4a14-aad5-48cc46aade2a-trusted-ca-bundle\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.466412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.466385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b456059a-f747-4a14-aad5-48cc46aade2a-console-serving-cert\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.466497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.466469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b456059a-f747-4a14-aad5-48cc46aade2a-console-oauth-config\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.472466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.472447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnr5t\" (UniqueName: \"kubernetes.io/projected/b456059a-f747-4a14-aad5-48cc46aade2a-kube-api-access-dnr5t\") pod \"console-96c4f7b6d-d8xth\" (UID: \"b456059a-f747-4a14-aad5-48cc46aade2a\") " pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.504181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.504142    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:08.779684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:08.779655    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96c4f7b6d-d8xth"]
Sep 11 18:24:08.782222 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:08.782181    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb456059a_f747_4a14_aad5_48cc46aade2a.slice/crio-738c13853c368055159ac123e5a7ee54fbbef29f5af5e07f3fdfc951cce90721 WatchSource:0}: Error finding container 738c13853c368055159ac123e5a7ee54fbbef29f5af5e07f3fdfc951cce90721: Status 404 returned error can't find the container with id 738c13853c368055159ac123e5a7ee54fbbef29f5af5e07f3fdfc951cce90721
Sep 11 18:24:09.002695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:09.002665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:09.326986 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:09.326945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c4f7b6d-d8xth" event={"ID":"b456059a-f747-4a14-aad5-48cc46aade2a","Type":"ContainerStarted","Data":"dce65bd87765e62f149b1829cb24af098bf0f32227357949484a0f5a952ea8da"}
Sep 11 18:24:09.327415 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:09.327037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c4f7b6d-d8xth" event={"ID":"b456059a-f747-4a14-aad5-48cc46aade2a","Type":"ContainerStarted","Data":"738c13853c368055159ac123e5a7ee54fbbef29f5af5e07f3fdfc951cce90721"}
Sep 11 18:24:09.346625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:09.346572    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96c4f7b6d-d8xth" podStartSLOduration=1.346555704 podStartE2EDuration="1.346555704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:09.344737523 +0000 UTC m=+491.919840995" watchObservedRunningTime="2026-09-11 18:24:09.346555704 +0000 UTC m=+491.921659172"
Sep 11 18:24:12.505936 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:12.505902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:14.568773 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.568738    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"]
Sep 11 18:24:14.572445 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.572427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:14.575242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.575215    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 18:24:14.575396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.575261    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-x9vck\""
Sep 11 18:24:14.575396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.575287    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 18:24:14.576088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.576070    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 18:24:14.585667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.585646    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"]
Sep 11 18:24:14.614190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.614161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9km\" (UniqueName: \"kubernetes.io/projected/5e079832-0c42-4e5e-8fed-974f8fadeea7-kube-api-access-bz9km\") pod \"dns-operator-controller-manager-7b84cd7c9c-jqq2r\" (UID: \"5e079832-0c42-4e5e-8fed-974f8fadeea7\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:14.715160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.715120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9km\" (UniqueName: \"kubernetes.io/projected/5e079832-0c42-4e5e-8fed-974f8fadeea7-kube-api-access-bz9km\") pod \"dns-operator-controller-manager-7b84cd7c9c-jqq2r\" (UID: \"5e079832-0c42-4e5e-8fed-974f8fadeea7\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:14.732448 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.732415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9km\" (UniqueName: \"kubernetes.io/projected/5e079832-0c42-4e5e-8fed-974f8fadeea7-kube-api-access-bz9km\") pod \"dns-operator-controller-manager-7b84cd7c9c-jqq2r\" (UID: \"5e079832-0c42-4e5e-8fed-974f8fadeea7\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:14.883164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.883065    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:14.988826 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:14.988785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:15.160776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:15.160749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"]
Sep 11 18:24:15.163282 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:15.163257    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e079832_0c42_4e5e_8fed_974f8fadeea7.slice/crio-5617a26c4c2cd3fc07f34a7b826fa5586d5d6c7b82485e73b5bb942c68b983d2 WatchSource:0}: Error finding container 5617a26c4c2cd3fc07f34a7b826fa5586d5d6c7b82485e73b5bb942c68b983d2: Status 404 returned error can't find the container with id 5617a26c4c2cd3fc07f34a7b826fa5586d5d6c7b82485e73b5bb942c68b983d2
Sep 11 18:24:15.309565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:15.309530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:15.363971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:15.363931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r" event={"ID":"5e079832-0c42-4e5e-8fed-974f8fadeea7","Type":"ContainerStarted","Data":"5617a26c4c2cd3fc07f34a7b826fa5586d5d6c7b82485e73b5bb942c68b983d2"}
Sep 11 18:24:16.757634 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:16.757601    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:17.712728 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:17.712682    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:18.015962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.015929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:18.149408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.149365    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:18.385981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.385895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r" event={"ID":"5e079832-0c42-4e5e-8fed-974f8fadeea7","Type":"ContainerStarted","Data":"e424e182ea4173e4d8d1c90ff7f9ed13975cf6ce8e243db8ff5fb9b87398839c"}
Sep 11 18:24:18.385981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.385958    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:18.407679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.407622    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r" podStartSLOduration=1.745926065 podStartE2EDuration="4.407603077s" totalImagesPullingTime="2.661677012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:18.40588985 +0000 UTC m=+500.980993318" watchObservedRunningTime="2026-09-11 18:24:18.407603077 +0000 UTC m=+500.982706545"
Sep 11 18:24:18.504978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.504936    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:18.505187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.505000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:18.509872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.509849    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:18.711511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:18.711419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:19.395534 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:19.395500    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96c4f7b6d-d8xth"
Sep 11 18:24:19.447848 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:19.447814    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f5955f6bd-x59dc"]
Sep 11 18:24:19.575621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:19.575587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:19.674667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:19.674568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:19.774685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:19.774646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:19.878687 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:19.878649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:21.634836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.634801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"]
Sep 11 18:24:21.638190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.638172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.640472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.640447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xz6wx\""
Sep 11 18:24:21.650163 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.650139    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"]
Sep 11 18:24:21.688073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.688042    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hk74\" (UniqueName: \"kubernetes.io/projected/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-kube-api-access-4hk74\") pod \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.688286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.688187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.789144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.789110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.789291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.789155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hk74\" (UniqueName: \"kubernetes.io/projected/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-kube-api-access-4hk74\") pod \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.789503 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.789482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.803242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.803217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hk74\" (UniqueName: \"kubernetes.io/projected/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-kube-api-access-4hk74\") pod \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:21.949884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:21.949805    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:22.155607 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:22.155570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:22.244500 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:22.244471    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"]
Sep 11 18:24:22.245669 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:22.245644    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1d881a_02f0_4cd7_b093_32f4ecd2c698.slice/crio-5fde8868fd368740a24435088d991ed1f014432bf1b71428a3a1eced6e7be9af WatchSource:0}: Error finding container 5fde8868fd368740a24435088d991ed1f014432bf1b71428a3a1eced6e7be9af: Status 404 returned error can't find the container with id 5fde8868fd368740a24435088d991ed1f014432bf1b71428a3a1eced6e7be9af
Sep 11 18:24:22.332971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:22.332940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:22.409747 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:22.409710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg" event={"ID":"6f1d881a-02f0-4cd7-b093-32f4ecd2c698","Type":"ContainerStarted","Data":"5fde8868fd368740a24435088d991ed1f014432bf1b71428a3a1eced6e7be9af"}
Sep 11 18:24:25.151400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:25.151368    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:25.254112 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:25.254076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:29.394970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:29.394938    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jqq2r"
Sep 11 18:24:30.324320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:30.324277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:30.419327 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:30.419268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:30.722615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:30.722529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:30.788478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:30.788450    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:31.475062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:31.475016    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg" event={"ID":"6f1d881a-02f0-4cd7-b093-32f4ecd2c698","Type":"ContainerStarted","Data":"504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d"}
Sep 11 18:24:31.475565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:31.475084    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:31.501620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:31.501574    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg" podStartSLOduration=1.972413913 podStartE2EDuration="10.501559692s" totalImagesPullingTime="8.529145779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:31.495416259 +0000 UTC m=+514.070519749" watchObservedRunningTime="2026-09-11 18:24:31.501559692 +0000 UTC m=+514.076663160"
Sep 11 18:24:33.497519 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.497484    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"]
Sep 11 18:24:33.502065 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.502043    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.503641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.503615    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:33.504652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.504629    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 18:24:33.504769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.504755    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 18:24:33.504920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.504905    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hgmpm\""
Sep 11 18:24:33.509103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.509081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"]
Sep 11 18:24:33.603416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.603382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/222c0326-956b-44e8-86ac-3e87e6c81e5f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.603627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.603422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/222c0326-956b-44e8-86ac-3e87e6c81e5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.603627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.603449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxrkq\" (UniqueName: \"kubernetes.io/projected/222c0326-956b-44e8-86ac-3e87e6c81e5f-kube-api-access-lxrkq\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.699828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.699784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:33.704961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.704941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/222c0326-956b-44e8-86ac-3e87e6c81e5f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.705063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.704971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/222c0326-956b-44e8-86ac-3e87e6c81e5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.705063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.704990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxrkq\" (UniqueName: \"kubernetes.io/projected/222c0326-956b-44e8-86ac-3e87e6c81e5f-kube-api-access-lxrkq\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.705641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.705619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/222c0326-956b-44e8-86ac-3e87e6c81e5f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.707430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.707410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/222c0326-956b-44e8-86ac-3e87e6c81e5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.715865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.715840    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxrkq\" (UniqueName: \"kubernetes.io/projected/222c0326-956b-44e8-86ac-3e87e6c81e5f-kube-api-access-lxrkq\") pod \"kuadrant-console-plugin-fbdd4f445-5nzvn\" (UID: \"222c0326-956b-44e8-86ac-3e87e6c81e5f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:33.813227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:33.813195    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"
Sep 11 18:24:34.086516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:34.086492    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn"]
Sep 11 18:24:34.088135 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:34.088104    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod222c0326_956b_44e8_86ac_3e87e6c81e5f.slice/crio-32d5d9df8a417f1e72221a3db38e495d82a605638c3f96c39c1ca2dada738f98 WatchSource:0}: Error finding container 32d5d9df8a417f1e72221a3db38e495d82a605638c3f96c39c1ca2dada738f98: Status 404 returned error can't find the container with id 32d5d9df8a417f1e72221a3db38e495d82a605638c3f96c39c1ca2dada738f98
Sep 11 18:24:34.494397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:34.494290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn" event={"ID":"222c0326-956b-44e8-86ac-3e87e6c81e5f","Type":"ContainerStarted","Data":"32d5d9df8a417f1e72221a3db38e495d82a605638c3f96c39c1ca2dada738f98"}
Sep 11 18:24:34.996703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:34.996637    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:35.094999 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:35.094947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:35.193865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:35.193818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:38.528917 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:38.528875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn" event={"ID":"222c0326-956b-44e8-86ac-3e87e6c81e5f","Type":"ContainerStarted","Data":"46dccb42b1f7748c3b60bc80572186bf5003e326dd53dfc2e1bd4440a9c2ef44"}
Sep 11 18:24:38.552650 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:38.552604    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5nzvn" podStartSLOduration=1.271408364 podStartE2EDuration="5.552588958s" totalImagesPullingTime="4.281180594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:38.550120014 +0000 UTC m=+521.125223483" watchObservedRunningTime="2026-09-11 18:24:38.552588958 +0000 UTC m=+521.127692426"
Sep 11 18:24:42.083726 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:42.083689    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:42.184741 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:42.184695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:42.483847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:42.483762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:44.468326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.468257    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f5955f6bd-x59dc" podUID="5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" containerName="console" containerID="cri-o://a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678" gracePeriod=15
Sep 11 18:24:44.660291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.660252    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"]
Sep 11 18:24:44.660821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.660787    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" containerName="manager" containerID="cri-o://504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d" gracePeriod=2
Sep 11 18:24:44.681708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.681587    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"]
Sep 11 18:24:44.684546 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:44.684515    2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\": pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:44.697523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.696868    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"]
Sep 11 18:24:44.697523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.697503    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" containerName="manager"
Sep 11 18:24:44.697523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.697522    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" containerName="manager"
Sep 11 18:24:44.697785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.697636    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" containerName="manager"
Sep 11 18:24:44.701647 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.701625    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:44.703922 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:44.703891    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:44.736682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.736656    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"]
Sep 11 18:24:44.754769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.754738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:44.791126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.791070    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:24:44.794172 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:44.794003    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:44.814667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.814627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xxm\" (UniqueName: \"kubernetes.io/projected/2cbad749-118c-4064-82bb-81ce53a8998b-kube-api-access-n5xxm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jtghv\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:44.814892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.814752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cbad749-118c-4064-82bb-81ce53a8998b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jtghv\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:44.908546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.908510    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:44.911246 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:44.911217    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:44.915497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915474    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-oauth-config\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915598 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915515    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-config\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915598 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-service-ca\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915699 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-trusted-ca-bundle\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915699 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915623    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzv4n\" (UniqueName: \"kubernetes.io/projected/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-kube-api-access-nzv4n\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915699 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915649    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-oauth-serving-cert\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915704    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-serving-cert\") pod \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\" (UID: \"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c\") "
Sep 11 18:24:44.915901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cbad749-118c-4064-82bb-81ce53a8998b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jtghv\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:44.915961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915923    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:44.916018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-config" (OuterVolumeSpecName: "console-config") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:44.916018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.915999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xxm\" (UniqueName: \"kubernetes.io/projected/2cbad749-118c-4064-82bb-81ce53a8998b-kube-api-access-n5xxm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jtghv\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:44.916126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.916098    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:44.916126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.916113    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:44.916247 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.916143    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:44.916330 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.916290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cbad749-118c-4064-82bb-81ce53a8998b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jtghv\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:44.916400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.916357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:24:44.917722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.917702    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-kube-api-access-nzv4n" (OuterVolumeSpecName: "kube-api-access-nzv4n") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "kube-api-access-nzv4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:44.917821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.917724    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:24:44.917821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.917779    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" (UID: "5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:24:44.932019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.931983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:44.932154 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:44.931998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xxm\" (UniqueName: \"kubernetes.io/projected/2cbad749-118c-4064-82bb-81ce53a8998b-kube-api-access-n5xxm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jtghv\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:45.017291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.017261    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-extensions-socket-volume\") pod \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") "
Sep 11 18:24:45.017464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.017360    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hk74\" (UniqueName: \"kubernetes.io/projected/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-kube-api-access-4hk74\") pod \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\" (UID: \"6f1d881a-02f0-4cd7-b093-32f4ecd2c698\") "
Sep 11 18:24:45.017856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.017823    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f1d881a-02f0-4cd7-b093-32f4ecd2c698" (UID: "6f1d881a-02f0-4cd7-b093-32f4ecd2c698"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:24:45.018005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.017965    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.018005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.017985    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.018005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.018001    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-extensions-socket-volume\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.018173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.018017    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-trusted-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.018173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.018027    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzv4n\" (UniqueName: \"kubernetes.io/projected/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-kube-api-access-nzv4n\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.018173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.018035    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.019750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.019727    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-kube-api-access-4hk74" (OuterVolumeSpecName: "kube-api-access-4hk74") pod "6f1d881a-02f0-4cd7-b093-32f4ecd2c698" (UID: "6f1d881a-02f0-4cd7-b093-32f4ecd2c698"). InnerVolumeSpecName "kube-api-access-4hk74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:24:45.037883 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.037859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:45.119082 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.119053    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hk74\" (UniqueName: \"kubernetes.io/projected/6f1d881a-02f0-4cd7-b093-32f4ecd2c698-kube-api-access-4hk74\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:24:45.338516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.338476    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"]
Sep 11 18:24:45.340681 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:24:45.340651    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbad749_118c_4064_82bb_81ce53a8998b.slice/crio-3dbd872b6040049e3747fb2a4c9ade794c0494c85718fb68d449a73d2ae00fbd WatchSource:0}: Error finding container 3dbd872b6040049e3747fb2a4c9ade794c0494c85718fb68d449a73d2ae00fbd: Status 404 returned error can't find the container with id 3dbd872b6040049e3747fb2a4c9ade794c0494c85718fb68d449a73d2ae00fbd
Sep 11 18:24:45.571206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.571175    2561 generic.go:356] "Generic (PLEG): container finished" podID="5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" containerID="a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678" exitCode=0
Sep 11 18:24:45.571690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.571221    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5955f6bd-x59dc"
Sep 11 18:24:45.571690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.571260    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5955f6bd-x59dc" event={"ID":"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c","Type":"ContainerDied","Data":"a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678"}
Sep 11 18:24:45.571690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.571334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5955f6bd-x59dc" event={"ID":"5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c","Type":"ContainerDied","Data":"de039c52da55f2cf743a10ea44be2883c0cd2186adf487e290a06bc67a735be5"}
Sep 11 18:24:45.571690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.571372    2561 scope.go:117] "RemoveContainer" containerID="a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678"
Sep 11 18:24:45.573568 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.573537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv" event={"ID":"2cbad749-118c-4064-82bb-81ce53a8998b","Type":"ContainerStarted","Data":"a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045"}
Sep 11 18:24:45.573716 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.573588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv" event={"ID":"2cbad749-118c-4064-82bb-81ce53a8998b","Type":"ContainerStarted","Data":"3dbd872b6040049e3747fb2a4c9ade794c0494c85718fb68d449a73d2ae00fbd"}
Sep 11 18:24:45.573716 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.573619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:24:45.575113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.575091    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" containerID="504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d" exitCode=0
Sep 11 18:24:45.575240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.575132    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:45.580468 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:45.580435    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:45.582591 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:45.582569    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:45.583889 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.583852    2561 scope.go:117] "RemoveContainer" containerID="a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678"
Sep 11 18:24:45.584152 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:45.584132    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678\": container with ID starting with a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678 not found: ID does not exist" containerID="a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678"
Sep 11 18:24:45.584202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.584171    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678"} err="failed to get container status \"a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678\": rpc error: code = NotFound desc = could not find container \"a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678\": container with ID starting with a15ee3d3de87f679aa83402bd7da0780ac6e71374b6b5d6c4c1282c7c7d17678 not found: ID does not exist"
Sep 11 18:24:45.584202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.584187    2561 scope.go:117] "RemoveContainer" containerID="504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d"
Sep 11 18:24:45.592997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.592979    2561 scope.go:117] "RemoveContainer" containerID="504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d"
Sep 11 18:24:45.593268 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:45.593246    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d\": container with ID starting with 504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d not found: ID does not exist" containerID="504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d"
Sep 11 18:24:45.593336 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.593274    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d"} err="failed to get container status \"504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d\": rpc error: code = NotFound desc = could not find container \"504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d\": container with ID starting with 504ca52cbe5cd69e4ef338ac89154890357dc789828ae9e10f166d258a2cf50d not found: ID does not exist"
Sep 11 18:24:45.606773 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.606732    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv" podStartSLOduration=1.606718035 podStartE2EDuration="1.606718035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:24:45.605773607 +0000 UTC m=+528.180877076" watchObservedRunningTime="2026-09-11 18:24:45.606718035 +0000 UTC m=+528.181821502"
Sep 11 18:24:45.626471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.626446    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f5955f6bd-x59dc"]
Sep 11 18:24:45.634502 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:24:45.634466    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-p5qjg\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-p5qjg"
Sep 11 18:24:45.636972 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.636954    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f5955f6bd-x59dc"]
Sep 11 18:24:45.908541 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.908466    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" path="/var/lib/kubelet/pods/5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c/volumes"
Sep 11 18:24:45.908852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:45.908839    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1d881a-02f0-4cd7-b093-32f4ecd2c698" path="/var/lib/kubelet/pods/6f1d881a-02f0-4cd7-b093-32f4ecd2c698/volumes"
Sep 11 18:24:50.082962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:50.082885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:50.183751 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:50.183710    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:50.477497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:50.477397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:50.546185 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:50.546150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:54.724839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:54.724809    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:54.825865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:54.825834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:54.926984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:54.926952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:55.021878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:55.021834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:55.508977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:55.508943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:55.609189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:55.609155    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:24:56.584922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:24:56.584883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:25:01.752064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:01.752031    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:01.856009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:01.855978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:07.661148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:07.661113    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"]
Sep 11 18:25:07.661750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:07.661372    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv" podUID="2cbad749-118c-4064-82bb-81ce53a8998b" containerName="manager" containerID="cri-o://a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045" gracePeriod=10
Sep 11 18:25:07.920204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:07.920140    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:25:08.017147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.017114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cbad749-118c-4064-82bb-81ce53a8998b-extensions-socket-volume\") pod \"2cbad749-118c-4064-82bb-81ce53a8998b\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") "
Sep 11 18:25:08.017328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.017238    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5xxm\" (UniqueName: \"kubernetes.io/projected/2cbad749-118c-4064-82bb-81ce53a8998b-kube-api-access-n5xxm\") pod \"2cbad749-118c-4064-82bb-81ce53a8998b\" (UID: \"2cbad749-118c-4064-82bb-81ce53a8998b\") "
Sep 11 18:25:08.017535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.017509    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cbad749-118c-4064-82bb-81ce53a8998b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2cbad749-118c-4064-82bb-81ce53a8998b" (UID: "2cbad749-118c-4064-82bb-81ce53a8998b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:25:08.019314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.019281    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cbad749-118c-4064-82bb-81ce53a8998b-kube-api-access-n5xxm" (OuterVolumeSpecName: "kube-api-access-n5xxm") pod "2cbad749-118c-4064-82bb-81ce53a8998b" (UID: "2cbad749-118c-4064-82bb-81ce53a8998b"). InnerVolumeSpecName "kube-api-access-n5xxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:25:08.118636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.118597    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5xxm\" (UniqueName: \"kubernetes.io/projected/2cbad749-118c-4064-82bb-81ce53a8998b-kube-api-access-n5xxm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:25:08.118636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.118628    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cbad749-118c-4064-82bb-81ce53a8998b-extensions-socket-volume\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:25:08.709937 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.709900    2561 generic.go:356] "Generic (PLEG): container finished" podID="2cbad749-118c-4064-82bb-81ce53a8998b" containerID="a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045" exitCode=0
Sep 11 18:25:08.710373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.709963    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"
Sep 11 18:25:08.710373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.709990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv" event={"ID":"2cbad749-118c-4064-82bb-81ce53a8998b","Type":"ContainerDied","Data":"a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045"}
Sep 11 18:25:08.710373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.710082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv" event={"ID":"2cbad749-118c-4064-82bb-81ce53a8998b","Type":"ContainerDied","Data":"3dbd872b6040049e3747fb2a4c9ade794c0494c85718fb68d449a73d2ae00fbd"}
Sep 11 18:25:08.710373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.710110    2561 scope.go:117] "RemoveContainer" containerID="a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045"
Sep 11 18:25:08.719836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.719818    2561 scope.go:117] "RemoveContainer" containerID="a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045"
Sep 11 18:25:08.720106 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:25:08.720087    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045\": container with ID starting with a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045 not found: ID does not exist" containerID="a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045"
Sep 11 18:25:08.720180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.720114    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045"} err="failed to get container status \"a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045\": rpc error: code = NotFound desc = could not find container \"a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045\": container with ID starting with a39c5275edde7deb1b812f5a43d5da46f1a9431e02b025668d9ed4d992549045 not found: ID does not exist"
Sep 11 18:25:08.732375 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.732351    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"]
Sep 11 18:25:08.739436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:08.739415    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jtghv"]
Sep 11 18:25:09.907839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:09.907806    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cbad749-118c-4064-82bb-81ce53a8998b" path="/var/lib/kubelet/pods/2cbad749-118c-4064-82bb-81ce53a8998b/volumes"
Sep 11 18:25:24.147501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147468    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"]
Sep 11 18:25:24.147870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147858    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cbad749-118c-4064-82bb-81ce53a8998b" containerName="manager"
Sep 11 18:25:24.147920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147872    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cbad749-118c-4064-82bb-81ce53a8998b" containerName="manager"
Sep 11 18:25:24.147920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147887    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" containerName="console"
Sep 11 18:25:24.147920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147892    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" containerName="console"
Sep 11 18:25:24.148013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147972    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed2ac48-e138-4b7a-bdc1-2a6b0bc1349c" containerName="console"
Sep 11 18:25:24.148013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.147981    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cbad749-118c-4064-82bb-81ce53a8998b" containerName="manager"
Sep 11 18:25:24.150018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.150002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.153636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.153616    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mrlbl\""
Sep 11 18:25:24.163242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.163215    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"]
Sep 11 18:25:24.181841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.181803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:24.257155 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5nxx\" (UniqueName: \"kubernetes.io/projected/9c153c1e-8d48-48e8-91ca-72007c5f97a6-kube-api-access-x5nxx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.257612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.257555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5nxx\" (UniqueName: \"kubernetes.io/projected/9c153c1e-8d48-48e8-91ca-72007c5f97a6-kube-api-access-x5nxx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358505    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358703    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.358878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.359045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.358953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.359336 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.359294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.361083 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.361060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.361336 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.361320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.367537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.367516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c153c1e-8d48-48e8-91ca-72007c5f97a6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.367976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.367954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5nxx\" (UniqueName: \"kubernetes.io/projected/9c153c1e-8d48-48e8-91ca-72007c5f97a6-kube-api-access-x5nxx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-v7wzs\" (UID: \"9c153c1e-8d48-48e8-91ca-72007c5f97a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.461394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.461293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:24.541109 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.541067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:24.741781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.741755    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"]
Sep 11 18:25:24.743536 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:25:24.743509    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c153c1e_8d48_48e8_91ca_72007c5f97a6.slice/crio-9290045e0a0d7b58738efbe495810e8f24ded034b2b5d7a6d4c03354c4f9be9b WatchSource:0}: Error finding container 9290045e0a0d7b58738efbe495810e8f24ded034b2b5d7a6d4c03354c4f9be9b: Status 404 returned error can't find the container with id 9290045e0a0d7b58738efbe495810e8f24ded034b2b5d7a6d4c03354c4f9be9b
Sep 11 18:25:24.745845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.745806    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:25:24.745928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.745884    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:25:24.745928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.745917    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:25:24.800210 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:24.800184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" event={"ID":"9c153c1e-8d48-48e8-91ca-72007c5f97a6","Type":"ContainerStarted","Data":"9290045e0a0d7b58738efbe495810e8f24ded034b2b5d7a6d4c03354c4f9be9b"}
Sep 11 18:25:25.807294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:25.807258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" event={"ID":"9c153c1e-8d48-48e8-91ca-72007c5f97a6","Type":"ContainerStarted","Data":"1b41bd50688b41a70fd8feca41bc31cf5d1907d896da09bd16562eeff912a86f"}
Sep 11 18:25:25.840386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:25.835081    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podStartSLOduration=1.835060495 podStartE2EDuration="1.835060495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:25:25.831703953 +0000 UTC m=+568.406807437" watchObservedRunningTime="2026-09-11 18:25:25.835060495 +0000 UTC m=+568.410163965"
Sep 11 18:25:26.461892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:26.461850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:26.466438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:26.466412    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:26.812911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:26.812877    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:26.813837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:26.813815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:25:28.242483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.242439    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:28.244045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.244019    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:28.245461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.245443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.247660 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.247638    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 18:25:28.254041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.254016    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:28.297693 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.297659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-config-file\") pod \"limitador-limitador-8588749977-7xq7t\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") " pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.297873 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.297738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2jf\" (UniqueName: \"kubernetes.io/projected/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-kube-api-access-mg2jf\") pod \"limitador-limitador-8588749977-7xq7t\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") " pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.343965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.343932    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:28.354752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.354722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:28.398846 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.398815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-config-file\") pod \"limitador-limitador-8588749977-7xq7t\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") " pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.398994 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.398891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2jf\" (UniqueName: \"kubernetes.io/projected/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-kube-api-access-mg2jf\") pod \"limitador-limitador-8588749977-7xq7t\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") " pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.399512 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.399492    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-config-file\") pod \"limitador-limitador-8588749977-7xq7t\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") " pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.406704 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.406678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2jf\" (UniqueName: \"kubernetes.io/projected/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-kube-api-access-mg2jf\") pod \"limitador-limitador-8588749977-7xq7t\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") " pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.409475 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.409448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:28.557865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.557826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:28.828587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:28.828558    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:28.830086 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:25:28.830062    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a3b25a_9d70_4c9f_b81d_6975d9134b3f.slice/crio-2e092ea7c0c5a691d28c0ade3a1ab8251706dd2ef9a159287bd93562318b374d WatchSource:0}: Error finding container 2e092ea7c0c5a691d28c0ade3a1ab8251706dd2ef9a159287bd93562318b374d: Status 404 returned error can't find the container with id 2e092ea7c0c5a691d28c0ade3a1ab8251706dd2ef9a159287bd93562318b374d
Sep 11 18:25:29.066774 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.066738    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hvfz9"]
Sep 11 18:25:29.069997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.069958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:29.072170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.072148    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2wp7p\""
Sep 11 18:25:29.077517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.077460    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hvfz9"]
Sep 11 18:25:29.102165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.102134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:29.191674 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.191642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:29.205358 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.205326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljg57\" (UniqueName: \"kubernetes.io/projected/213cfef0-c0ff-49e7-a704-e6ffb370c9c3-kube-api-access-ljg57\") pod \"authorino-7bcfd8f9cd-hvfz9\" (UID: \"213cfef0-c0ff-49e7-a704-e6ffb370c9c3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:29.306118 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.306082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljg57\" (UniqueName: \"kubernetes.io/projected/213cfef0-c0ff-49e7-a704-e6ffb370c9c3-kube-api-access-ljg57\") pod \"authorino-7bcfd8f9cd-hvfz9\" (UID: \"213cfef0-c0ff-49e7-a704-e6ffb370c9c3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:29.319591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.319567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljg57\" (UniqueName: \"kubernetes.io/projected/213cfef0-c0ff-49e7-a704-e6ffb370c9c3-kube-api-access-ljg57\") pod \"authorino-7bcfd8f9cd-hvfz9\" (UID: \"213cfef0-c0ff-49e7-a704-e6ffb370c9c3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:29.380752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.380678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:29.650999 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.650971    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hvfz9"]
Sep 11 18:25:29.652582 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:25:29.652561    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod213cfef0_c0ff_49e7_a704_e6ffb370c9c3.slice/crio-7c1741339e8df104bcf0a86d4a10473987cf2f00c448c21b91582427ebd91a61 WatchSource:0}: Error finding container 7c1741339e8df104bcf0a86d4a10473987cf2f00c448c21b91582427ebd91a61: Status 404 returned error can't find the container with id 7c1741339e8df104bcf0a86d4a10473987cf2f00c448c21b91582427ebd91a61
Sep 11 18:25:29.833480 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.833443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9" event={"ID":"213cfef0-c0ff-49e7-a704-e6ffb370c9c3","Type":"ContainerStarted","Data":"7c1741339e8df104bcf0a86d4a10473987cf2f00c448c21b91582427ebd91a61"}
Sep 11 18:25:29.835222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:29.835195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t" event={"ID":"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f","Type":"ContainerStarted","Data":"2e092ea7c0c5a691d28c0ade3a1ab8251706dd2ef9a159287bd93562318b374d"}
Sep 11 18:25:30.844989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:30.844949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t" event={"ID":"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f","Type":"ContainerStarted","Data":"14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994"}
Sep 11 18:25:30.845449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:30.845150    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:30.864469 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:30.864410    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t" podStartSLOduration=1.580536046 podStartE2EDuration="2.864394706s" totalImagesPullingTime="1.28385866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:25:30.861866696 +0000 UTC m=+573.436970164" watchObservedRunningTime="2026-09-11 18:25:30.864394706 +0000 UTC m=+573.439498173"
Sep 11 18:25:31.853520 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:31.853481    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9" event={"ID":"213cfef0-c0ff-49e7-a704-e6ffb370c9c3","Type":"ContainerStarted","Data":"46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0"}
Sep 11 18:25:31.869792 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:31.869742    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9" podStartSLOduration=1.21901466 podStartE2EDuration="2.869727201s" totalImagesPullingTime="1.650712541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:25:31.867192893 +0000 UTC m=+574.442296363" watchObservedRunningTime="2026-09-11 18:25:31.869727201 +0000 UTC m=+574.444830668"
Sep 11 18:25:32.578991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:32.578950    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hvfz9"]
Sep 11 18:25:33.865803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:33.865741    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9" podUID="213cfef0-c0ff-49e7-a704-e6ffb370c9c3" containerName="authorino" containerID="cri-o://46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0" gracePeriod=30
Sep 11 18:25:34.107871 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.107841    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:34.255236 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.255206    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljg57\" (UniqueName: \"kubernetes.io/projected/213cfef0-c0ff-49e7-a704-e6ffb370c9c3-kube-api-access-ljg57\") pod \"213cfef0-c0ff-49e7-a704-e6ffb370c9c3\" (UID: \"213cfef0-c0ff-49e7-a704-e6ffb370c9c3\") "
Sep 11 18:25:34.257378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.257355    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/213cfef0-c0ff-49e7-a704-e6ffb370c9c3-kube-api-access-ljg57" (OuterVolumeSpecName: "kube-api-access-ljg57") pod "213cfef0-c0ff-49e7-a704-e6ffb370c9c3" (UID: "213cfef0-c0ff-49e7-a704-e6ffb370c9c3"). InnerVolumeSpecName "kube-api-access-ljg57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:25:34.357017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.356979    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljg57\" (UniqueName: \"kubernetes.io/projected/213cfef0-c0ff-49e7-a704-e6ffb370c9c3-kube-api-access-ljg57\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:25:34.876590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.876549    2561 generic.go:356] "Generic (PLEG): container finished" podID="213cfef0-c0ff-49e7-a704-e6ffb370c9c3" containerID="46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0" exitCode=0
Sep 11 18:25:34.877053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.876611    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9"
Sep 11 18:25:34.877053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.876641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9" event={"ID":"213cfef0-c0ff-49e7-a704-e6ffb370c9c3","Type":"ContainerDied","Data":"46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0"}
Sep 11 18:25:34.877053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.876695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hvfz9" event={"ID":"213cfef0-c0ff-49e7-a704-e6ffb370c9c3","Type":"ContainerDied","Data":"7c1741339e8df104bcf0a86d4a10473987cf2f00c448c21b91582427ebd91a61"}
Sep 11 18:25:34.877053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.876713    2561 scope.go:117] "RemoveContainer" containerID="46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0"
Sep 11 18:25:34.886312 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.886285    2561 scope.go:117] "RemoveContainer" containerID="46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0"
Sep 11 18:25:34.886640 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:25:34.886621    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0\": container with ID starting with 46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0 not found: ID does not exist" containerID="46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0"
Sep 11 18:25:34.886699 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.886648    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0"} err="failed to get container status \"46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0\": rpc error: code = NotFound desc = could not find container \"46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0\": container with ID starting with 46c98b12d02554e25c8e24417657a0c5352ad455942ee24af35e5d5117b65dd0 not found: ID does not exist"
Sep 11 18:25:34.898474 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.898442    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hvfz9"]
Sep 11 18:25:34.900880 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:34.900859    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hvfz9"]
Sep 11 18:25:35.907115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:35.907073    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="213cfef0-c0ff-49e7-a704-e6ffb370c9c3" path="/var/lib/kubelet/pods/213cfef0-c0ff-49e7-a704-e6ffb370c9c3/volumes"
Sep 11 18:25:41.854930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:41.854894    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:43.596355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:43.596320    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:43.596817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:43.596512    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t" podUID="c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" containerName="limitador" containerID="cri-o://14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994" gracePeriod=30
Sep 11 18:25:44.162572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.162505    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:44.256085 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.256049    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-config-file\") pod \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") "
Sep 11 18:25:44.256293 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.256183    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg2jf\" (UniqueName: \"kubernetes.io/projected/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-kube-api-access-mg2jf\") pod \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\" (UID: \"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f\") "
Sep 11 18:25:44.256527 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.256501    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-config-file" (OuterVolumeSpecName: "config-file") pod "c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" (UID: "c2a3b25a-9d70-4c9f-b81d-6975d9134b3f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:25:44.258417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.258391    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-kube-api-access-mg2jf" (OuterVolumeSpecName: "kube-api-access-mg2jf") pod "c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" (UID: "c2a3b25a-9d70-4c9f-b81d-6975d9134b3f"). InnerVolumeSpecName "kube-api-access-mg2jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:25:44.356967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.356936    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-config-file\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.356967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.356964    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg2jf\" (UniqueName: \"kubernetes.io/projected/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f-kube-api-access-mg2jf\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:25:44.933993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.933952    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" containerID="14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994" exitCode=0
Sep 11 18:25:44.934421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.934021    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t"
Sep 11 18:25:44.934421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.934033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t" event={"ID":"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f","Type":"ContainerDied","Data":"14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994"}
Sep 11 18:25:44.934421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.934092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-7xq7t" event={"ID":"c2a3b25a-9d70-4c9f-b81d-6975d9134b3f","Type":"ContainerDied","Data":"2e092ea7c0c5a691d28c0ade3a1ab8251706dd2ef9a159287bd93562318b374d"}
Sep 11 18:25:44.934421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.934114    2561 scope.go:117] "RemoveContainer" containerID="14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994"
Sep 11 18:25:44.943468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.943450    2561 scope.go:117] "RemoveContainer" containerID="14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994"
Sep 11 18:25:44.943747 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:25:44.943725    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994\": container with ID starting with 14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994 not found: ID does not exist" containerID="14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994"
Sep 11 18:25:44.943813 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.943755    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994"} err="failed to get container status \"14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994\": rpc error: code = NotFound desc = could not find container \"14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994\": container with ID starting with 14090a39f9fea5b7acfc418d50da477ffd0b075ae91a4248d1d9377130993994 not found: ID does not exist"
Sep 11 18:25:44.955167 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.955143    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:44.961625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:44.961596    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-7xq7t"]
Sep 11 18:25:45.907608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:45.907575    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" path="/var/lib/kubelet/pods/c2a3b25a-9d70-4c9f-b81d-6975d9134b3f/volumes"
Sep 11 18:25:48.186234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.186192    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:48.249518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.249475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:48.627879 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.627844    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"]
Sep 11 18:25:48.628444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.628420    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="213cfef0-c0ff-49e7-a704-e6ffb370c9c3" containerName="authorino"
Sep 11 18:25:48.628444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.628439    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="213cfef0-c0ff-49e7-a704-e6ffb370c9c3" containerName="authorino"
Sep 11 18:25:48.628444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.628452    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" containerName="limitador"
Sep 11 18:25:48.628713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.628457    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" containerName="limitador"
Sep 11 18:25:48.628713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.628546    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="213cfef0-c0ff-49e7-a704-e6ffb370c9c3" containerName="authorino"
Sep 11 18:25:48.628713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.628556    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a3b25a-9d70-4c9f-b81d-6975d9134b3f" containerName="limitador"
Sep 11 18:25:48.631469 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.631449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.635295 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.635274    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:25:48.635423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.635336    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 18:25:48.635495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.635336    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 18:25:48.635495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.635433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vmt7z\""
Sep 11 18:25:48.641539 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.641517    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"]
Sep 11 18:25:48.661610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.661589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:48.698990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.698960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58faf6a9-5058-46a0-b2af-eda095386e4f-data\") pod \"postgres-69fb4594cf-2nfl9\" (UID: \"58faf6a9-5058-46a0-b2af-eda095386e4f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.699159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.699097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5q6\" (UniqueName: \"kubernetes.io/projected/58faf6a9-5058-46a0-b2af-eda095386e4f-kube-api-access-rf5q6\") pod \"postgres-69fb4594cf-2nfl9\" (UID: \"58faf6a9-5058-46a0-b2af-eda095386e4f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.799905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.799868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5q6\" (UniqueName: \"kubernetes.io/projected/58faf6a9-5058-46a0-b2af-eda095386e4f-kube-api-access-rf5q6\") pod \"postgres-69fb4594cf-2nfl9\" (UID: \"58faf6a9-5058-46a0-b2af-eda095386e4f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.800098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.799931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58faf6a9-5058-46a0-b2af-eda095386e4f-data\") pod \"postgres-69fb4594cf-2nfl9\" (UID: \"58faf6a9-5058-46a0-b2af-eda095386e4f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.800276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.800257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58faf6a9-5058-46a0-b2af-eda095386e4f-data\") pod \"postgres-69fb4594cf-2nfl9\" (UID: \"58faf6a9-5058-46a0-b2af-eda095386e4f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.807721 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.807701    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5q6\" (UniqueName: \"kubernetes.io/projected/58faf6a9-5058-46a0-b2af-eda095386e4f-kube-api-access-rf5q6\") pod \"postgres-69fb4594cf-2nfl9\" (UID: \"58faf6a9-5058-46a0-b2af-eda095386e4f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:48.944156 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:48.944075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:49.236656 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:49.236624    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"]
Sep 11 18:25:49.238439 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:25:49.238413    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58faf6a9_5058_46a0_b2af_eda095386e4f.slice/crio-015e63c1632a2f7cd04bd72c09fa96c4e83f29f920af35e0771ca6996b44254c WatchSource:0}: Error finding container 015e63c1632a2f7cd04bd72c09fa96c4e83f29f920af35e0771ca6996b44254c: Status 404 returned error can't find the container with id 015e63c1632a2f7cd04bd72c09fa96c4e83f29f920af35e0771ca6996b44254c
Sep 11 18:25:49.969518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:49.969475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9" event={"ID":"58faf6a9-5058-46a0-b2af-eda095386e4f","Type":"ContainerStarted","Data":"015e63c1632a2f7cd04bd72c09fa96c4e83f29f920af35e0771ca6996b44254c"}
Sep 11 18:25:51.987098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:51.987057    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9" event={"ID":"58faf6a9-5058-46a0-b2af-eda095386e4f","Type":"ContainerStarted","Data":"a5b9bdf72a6abb196aafba74532cf577c2c861be26ade1e925ace83bbc47fbab"}
Sep 11 18:25:51.987522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:51.987233    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:52.004249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:52.004197    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9" podStartSLOduration=2.052067813 podStartE2EDuration="4.004182055s" totalImagesPullingTime="1.952114242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:25:52.001783543 +0000 UTC m=+594.576887013" watchObservedRunningTime="2026-09-11 18:25:52.004182055 +0000 UTC m=+594.579285523"
Sep 11 18:25:57.836177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:57.836145    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:25:57.837957 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:57.837932    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:25:58.021619 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:58.021590    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nfl9"
Sep 11 18:25:58.309964 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:58.309925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:25:59.028882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:25:59.028846    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:05.563227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.563188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:05.595869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.595801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5476589467-vzsm5"]
Sep 11 18:26:05.604556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.604533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.607069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.607034    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 18:26:05.607213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.607183    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 18:26:05.608105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.608080    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jzqpz\""
Sep 11 18:26:05.608215 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.608131    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 18:26:05.611608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.611587    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5476589467-vzsm5"]
Sep 11 18:26:05.648318 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.648263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdzg7\" (UniqueName: \"kubernetes.io/projected/b99bf372-4c35-4805-950b-2fbaa1bd193f-kube-api-access-bdzg7\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.648502 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.648371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.648502 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.648395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.663271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.663234    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:05.731264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.731234    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:05.749037 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.749013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdzg7\" (UniqueName: \"kubernetes.io/projected/b99bf372-4c35-4805-950b-2fbaa1bd193f-kube-api-access-bdzg7\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.749181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.749060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.749181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.749078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.749181 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:05.749169    2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 18:26:05.749320 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:05.749197    2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 18:26:05.749320 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:05.749245    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert podName:b99bf372-4c35-4805-950b-2fbaa1bd193f nodeName:}" failed. No retries permitted until 2026-09-11 18:26:06.249226679 +0000 UTC m=+608.824330137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert") pod "maas-controller-5476589467-vzsm5" (UID: "b99bf372-4c35-4805-950b-2fbaa1bd193f") : secret "maas-controller-webhook-cert" not found
Sep 11 18:26:05.749320 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:05.749264    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs podName:b99bf372-4c35-4805-950b-2fbaa1bd193f nodeName:}" failed. No retries permitted until 2026-09-11 18:26:06.249255799 +0000 UTC m=+608.824359245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs") pod "maas-controller-5476589467-vzsm5" (UID: "b99bf372-4c35-4805-950b-2fbaa1bd193f") : secret "maas-controller-metrics-tls" not found
Sep 11 18:26:05.760401 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.760374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdzg7\" (UniqueName: \"kubernetes.io/projected/b99bf372-4c35-4805-950b-2fbaa1bd193f-kube-api-access-bdzg7\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:05.784168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.784135    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55dfcbfd4c-hvcdp"]
Sep 11 18:26:05.787994 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.787975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.799391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.799367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dfcbfd4c-hvcdp"]
Sep 11 18:26:05.850280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.850196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-metrics-certs\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.850280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.850267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf8t9\" (UniqueName: \"kubernetes.io/projected/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-kube-api-access-rf8t9\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.850497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.850333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.926803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.926767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:05.950956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.950926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-metrics-certs\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.951105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.951014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf8t9\" (UniqueName: \"kubernetes.io/projected/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-kube-api-access-rf8t9\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.951105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.951072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.951205 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:05.951174    2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 18:26:05.951253 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:05.951242    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert podName:e1815f9e-f85a-45b3-9cfb-7b821c1e5d42 nodeName:}" failed. No retries permitted until 2026-09-11 18:26:06.451226666 +0000 UTC m=+609.026330112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert") pod "maas-controller-55dfcbfd4c-hvcdp" (UID: "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42") : secret "maas-controller-webhook-cert" not found
Sep 11 18:26:05.953563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.953540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-metrics-certs\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:05.961423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:05.961402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf8t9\" (UniqueName: \"kubernetes.io/projected/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-kube-api-access-rf8t9\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:06.158450 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.158351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:06.254800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.254759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:06.254800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.254801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:06.257208 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.257181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:06.257383 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.257362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert\") pod \"maas-controller-5476589467-vzsm5\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") " pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:06.457270 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.457184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:06.459610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.459591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert\") pod \"maas-controller-55dfcbfd4c-hvcdp\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") " pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:06.517436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.517408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:06.700610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.700575    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:06.790512 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.790487    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5476589467-vzsm5"]
Sep 11 18:26:06.792611 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:26:06.792583    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99bf372_4c35_4805_950b_2fbaa1bd193f.slice/crio-2c7fd6afec8eb5ff1c4c356de77c86fbaa646753f3b2a6e0eb1c91307a2853af WatchSource:0}: Error finding container 2c7fd6afec8eb5ff1c4c356de77c86fbaa646753f3b2a6e0eb1c91307a2853af: Status 404 returned error can't find the container with id 2c7fd6afec8eb5ff1c4c356de77c86fbaa646753f3b2a6e0eb1c91307a2853af
Sep 11 18:26:06.971673 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:06.971648    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dfcbfd4c-hvcdp"]
Sep 11 18:26:06.973053 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:26:06.973017    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1815f9e_f85a_45b3_9cfb_7b821c1e5d42.slice/crio-0ad8d0282ae65835fac31e97a88c0a98381f0c530a359e625d49cfe0cf9ef239 WatchSource:0}: Error finding container 0ad8d0282ae65835fac31e97a88c0a98381f0c530a359e625d49cfe0cf9ef239: Status 404 returned error can't find the container with id 0ad8d0282ae65835fac31e97a88c0a98381f0c530a359e625d49cfe0cf9ef239
Sep 11 18:26:07.078710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:07.078668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476589467-vzsm5" event={"ID":"b99bf372-4c35-4805-950b-2fbaa1bd193f","Type":"ContainerStarted","Data":"2c7fd6afec8eb5ff1c4c356de77c86fbaa646753f3b2a6e0eb1c91307a2853af"}
Sep 11 18:26:07.079973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:07.079936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" event={"ID":"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42","Type":"ContainerStarted","Data":"0ad8d0282ae65835fac31e97a88c0a98381f0c530a359e625d49cfe0cf9ef239"}
Sep 11 18:26:09.644085 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:09.644046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:09.761478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:09.761441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:10.103440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:10.103349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476589467-vzsm5" event={"ID":"b99bf372-4c35-4805-950b-2fbaa1bd193f","Type":"ContainerStarted","Data":"d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d"}
Sep 11 18:26:10.103440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:10.103417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:10.104949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:10.104920    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" event={"ID":"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42","Type":"ContainerStarted","Data":"2d12b027488c632d79805526142c8f8a1656600651998a2afa5f020e001f72fa"}
Sep 11 18:26:10.105063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:10.104999    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:10.125163 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:10.125111    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5476589467-vzsm5" podStartSLOduration=2.463276199 podStartE2EDuration="5.125093495s" totalImagesPullingTime="2.661817296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:26:10.121549809 +0000 UTC m=+612.696653278" watchObservedRunningTime="2026-09-11 18:26:10.125093495 +0000 UTC m=+612.700196963"
Sep 11 18:26:10.142988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:10.142938    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" podStartSLOduration=2.653772693 podStartE2EDuration="5.142921795s" totalImagesPullingTime="2.489149102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:26:10.140154137 +0000 UTC m=+612.715257618" watchObservedRunningTime="2026-09-11 18:26:10.142921795 +0000 UTC m=+612.718025262"
Sep 11 18:26:21.113796 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.113715    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:26:21.116326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.113838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:21.168409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.168372    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5476589467-vzsm5"]
Sep 11 18:26:21.173239 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.173182    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5476589467-vzsm5" podUID="b99bf372-4c35-4805-950b-2fbaa1bd193f" containerName="manager" containerID="cri-o://d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d" gracePeriod=30
Sep 11 18:26:21.427289 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.427260    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:21.507917 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.507881    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdzg7\" (UniqueName: \"kubernetes.io/projected/b99bf372-4c35-4805-950b-2fbaa1bd193f-kube-api-access-bdzg7\") pod \"b99bf372-4c35-4805-950b-2fbaa1bd193f\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") "
Sep 11 18:26:21.508126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.507946    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert\") pod \"b99bf372-4c35-4805-950b-2fbaa1bd193f\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") "
Sep 11 18:26:21.508126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.507988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs\") pod \"b99bf372-4c35-4805-950b-2fbaa1bd193f\" (UID: \"b99bf372-4c35-4805-950b-2fbaa1bd193f\") "
Sep 11 18:26:21.510265 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.510232    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b99bf372-4c35-4805-950b-2fbaa1bd193f" (UID: "b99bf372-4c35-4805-950b-2fbaa1bd193f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:26:21.510412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.510295    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b99bf372-4c35-4805-950b-2fbaa1bd193f" (UID: "b99bf372-4c35-4805-950b-2fbaa1bd193f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:26:21.510412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.510292    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99bf372-4c35-4805-950b-2fbaa1bd193f-kube-api-access-bdzg7" (OuterVolumeSpecName: "kube-api-access-bdzg7") pod "b99bf372-4c35-4805-950b-2fbaa1bd193f" (UID: "b99bf372-4c35-4805-950b-2fbaa1bd193f"). InnerVolumeSpecName "kube-api-access-bdzg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:26:21.608947 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.608906    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-webhook-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:26:21.608947 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.608937    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99bf372-4c35-4805-950b-2fbaa1bd193f-metrics-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:26:21.608947 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:21.608946    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdzg7\" (UniqueName: \"kubernetes.io/projected/b99bf372-4c35-4805-950b-2fbaa1bd193f-kube-api-access-bdzg7\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:26:22.180919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.180811    2561 generic.go:356] "Generic (PLEG): container finished" podID="b99bf372-4c35-4805-950b-2fbaa1bd193f" containerID="d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d" exitCode=0
Sep 11 18:26:22.180919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.180851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476589467-vzsm5"
Sep 11 18:26:22.181430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.180912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476589467-vzsm5" event={"ID":"b99bf372-4c35-4805-950b-2fbaa1bd193f","Type":"ContainerDied","Data":"d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d"}
Sep 11 18:26:22.181430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.180971    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476589467-vzsm5" event={"ID":"b99bf372-4c35-4805-950b-2fbaa1bd193f","Type":"ContainerDied","Data":"2c7fd6afec8eb5ff1c4c356de77c86fbaa646753f3b2a6e0eb1c91307a2853af"}
Sep 11 18:26:22.181430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.181004    2561 scope.go:117] "RemoveContainer" containerID="d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d"
Sep 11 18:26:22.190832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.190812    2561 scope.go:117] "RemoveContainer" containerID="d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d"
Sep 11 18:26:22.191106 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:22.191087    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d\": container with ID starting with d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d not found: ID does not exist" containerID="d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d"
Sep 11 18:26:22.191184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.191117    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d"} err="failed to get container status \"d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d\": rpc error: code = NotFound desc = could not find container \"d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d\": container with ID starting with d0a0e2a9f8350a2be65b84996d9a8f87dcb960b8456bb6e109cec6efb029109d not found: ID does not exist"
Sep 11 18:26:22.198782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.198753    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5476589467-vzsm5"]
Sep 11 18:26:22.202989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:22.202965    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5476589467-vzsm5"]
Sep 11 18:26:23.908085 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:23.908048    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b99bf372-4c35-4805-950b-2fbaa1bd193f" path="/var/lib/kubelet/pods/b99bf372-4c35-4805-950b-2fbaa1bd193f/volumes"
Sep 11 18:26:30.187489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:30.187453    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:42.745470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:42.745429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:42.847166 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:42.847127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:44.223222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.223177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:44.327428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.327389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:44.454521 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.454484    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"]
Sep 11 18:26:44.454995 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.454975    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99bf372-4c35-4805-950b-2fbaa1bd193f" containerName="manager"
Sep 11 18:26:44.455082 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.454996    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99bf372-4c35-4805-950b-2fbaa1bd193f" containerName="manager"
Sep 11 18:26:44.455156 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.455142    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99bf372-4c35-4805-950b-2fbaa1bd193f" containerName="manager"
Sep 11 18:26:44.459899 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.459876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.462228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.462207    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:26:44.463178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.463164    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lvtx6\""
Sep 11 18:26:44.463178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.463169    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 18:26:44.469997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.469973    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"]
Sep 11 18:26:44.491803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.491706    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:44.517428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.517379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49549f2f-fa27-4716-a06f-65de6f328976-openshift-service-ca\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.517428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.517417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8px8s\" (UniqueName: \"kubernetes.io/projected/49549f2f-fa27-4716-a06f-65de6f328976-kube-api-access-8px8s\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.517669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.517496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.517669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.517549    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-maas-api-tls\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.618156 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.618121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49549f2f-fa27-4716-a06f-65de6f328976-openshift-service-ca\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.618156 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.618155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8px8s\" (UniqueName: \"kubernetes.io/projected/49549f2f-fa27-4716-a06f-65de6f328976-kube-api-access-8px8s\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.618471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.618185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.618471 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:44.618268    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 11 18:26:44.618471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.618317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-maas-api-tls\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.618471 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:26:44.618342    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs podName:49549f2f-fa27-4716-a06f-65de6f328976 nodeName:}" failed. No retries permitted until 2026-09-11 18:26:45.118322547 +0000 UTC m=+647.693426009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs") pod "maas-api-6598bdcc8c-mvqm7" (UID: "49549f2f-fa27-4716-a06f-65de6f328976") : secret "maas-api-metrics-tls" not found
Sep 11 18:26:44.618911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.618891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49549f2f-fa27-4716-a06f-65de6f328976-openshift-service-ca\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.620638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.620621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-maas-api-tls\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.626648 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.626628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8px8s\" (UniqueName: \"kubernetes.io/projected/49549f2f-fa27-4716-a06f-65de6f328976-kube-api-access-8px8s\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:44.850181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.850148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:44.942651 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.942621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:44.977198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.977164    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wwts9"]
Sep 11 18:26:44.979885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.979867    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:44.982443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.982393    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 18:26:44.982568 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.982529    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8zxk6\""
Sep 11 18:26:44.993908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:44.993879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wwts9"]
Sep 11 18:26:45.022666 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.022630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e23eb1a-f598-4bdd-9d8e-bd4747435813-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wwts9\" (UID: \"0e23eb1a-f598-4bdd-9d8e-bd4747435813\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.022850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.022681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqbg\" (UniqueName: \"kubernetes.io/projected/0e23eb1a-f598-4bdd-9d8e-bd4747435813-kube-api-access-nnqbg\") pod \"payload-processing-5b54b7fbb7-wwts9\" (UID: \"0e23eb1a-f598-4bdd-9d8e-bd4747435813\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.027240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.027208    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:45.123590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.123497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e23eb1a-f598-4bdd-9d8e-bd4747435813-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wwts9\" (UID: \"0e23eb1a-f598-4bdd-9d8e-bd4747435813\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.123590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.123554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqbg\" (UniqueName: \"kubernetes.io/projected/0e23eb1a-f598-4bdd-9d8e-bd4747435813-kube-api-access-nnqbg\") pod \"payload-processing-5b54b7fbb7-wwts9\" (UID: \"0e23eb1a-f598-4bdd-9d8e-bd4747435813\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.123820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.123619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:45.124254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.124232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e23eb1a-f598-4bdd-9d8e-bd4747435813-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wwts9\" (UID: \"0e23eb1a-f598-4bdd-9d8e-bd4747435813\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.126104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.126078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs\") pod \"maas-api-6598bdcc8c-mvqm7\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") " pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:45.131667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.131635    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqbg\" (UniqueName: \"kubernetes.io/projected/0e23eb1a-f598-4bdd-9d8e-bd4747435813-kube-api-access-nnqbg\") pod \"payload-processing-5b54b7fbb7-wwts9\" (UID: \"0e23eb1a-f598-4bdd-9d8e-bd4747435813\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.292864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.292830    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:45.372394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.372357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:45.568241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.568214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wwts9"]
Sep 11 18:26:45.569749 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:26:45.569720    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e23eb1a_f598_4bdd_9d8e_bd4747435813.slice/crio-a9ef1a13cccb272362bd26f29be3562677ceeaa6897a461bf5a0b69d506fc5b3 WatchSource:0}: Error finding container a9ef1a13cccb272362bd26f29be3562677ceeaa6897a461bf5a0b69d506fc5b3: Status 404 returned error can't find the container with id a9ef1a13cccb272362bd26f29be3562677ceeaa6897a461bf5a0b69d506fc5b3
Sep 11 18:26:45.571905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.571884    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:26:45.652483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:45.652454    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"]
Sep 11 18:26:45.654009 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:26:45.653979    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49549f2f_fa27_4716_a06f_65de6f328976.slice/crio-11ee4fe68b9529fa92bfc3ad7a30a0993fce28fe796dc390715b1c64a6f07ef4 WatchSource:0}: Error finding container 11ee4fe68b9529fa92bfc3ad7a30a0993fce28fe796dc390715b1c64a6f07ef4: Status 404 returned error can't find the container with id 11ee4fe68b9529fa92bfc3ad7a30a0993fce28fe796dc390715b1c64a6f07ef4
Sep 11 18:26:46.325245 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:46.325186    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7" event={"ID":"49549f2f-fa27-4716-a06f-65de6f328976","Type":"ContainerStarted","Data":"11ee4fe68b9529fa92bfc3ad7a30a0993fce28fe796dc390715b1c64a6f07ef4"}
Sep 11 18:26:46.333814 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:46.333772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9" event={"ID":"0e23eb1a-f598-4bdd-9d8e-bd4747435813","Type":"ContainerStarted","Data":"a9ef1a13cccb272362bd26f29be3562677ceeaa6897a461bf5a0b69d506fc5b3"}
Sep 11 18:26:48.355420 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:48.355376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9" event={"ID":"0e23eb1a-f598-4bdd-9d8e-bd4747435813","Type":"ContainerStarted","Data":"b7568ac903007f7f49e1bb53d56be31a18610ca0e5814ef385ca3c542060ed8b"}
Sep 11 18:26:48.356260 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:48.356234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:26:48.358267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:48.358236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7" event={"ID":"49549f2f-fa27-4716-a06f-65de6f328976","Type":"ContainerStarted","Data":"ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d"}
Sep 11 18:26:48.358830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:48.358807    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:48.375615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:48.375566    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9" podStartSLOduration=2.216381561 podStartE2EDuration="4.375550327s" totalImagesPullingTime="2.159168766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:26:48.372233836 +0000 UTC m=+650.947337305" watchObservedRunningTime="2026-09-11 18:26:48.375550327 +0000 UTC m=+650.950653786"
Sep 11 18:26:48.389003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:48.388942    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7" podStartSLOduration=2.310912119 podStartE2EDuration="4.388926608s" totalImagesPullingTime="2.078014489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:26:48.388699276 +0000 UTC m=+650.963802745" watchObservedRunningTime="2026-09-11 18:26:48.388926608 +0000 UTC m=+650.964030077"
Sep 11 18:26:54.401916 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:54.401888    2561 generic.go:356] "Generic (PLEG): container finished" podID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerID="1b41bd50688b41a70fd8feca41bc31cf5d1907d896da09bd16562eeff912a86f" exitCode=0
Sep 11 18:26:54.402227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:54.401934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" event={"ID":"9c153c1e-8d48-48e8-91ca-72007c5f97a6","Type":"ContainerDied","Data":"1b41bd50688b41a70fd8feca41bc31cf5d1907d896da09bd16562eeff912a86f"}
Sep 11 18:26:54.402373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:54.402359    2561 scope.go:117] "RemoveContainer" containerID="1b41bd50688b41a70fd8feca41bc31cf5d1907d896da09bd16562eeff912a86f"
Sep 11 18:26:54.403349 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:54.403296    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:26:54.403407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:54.403391    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:26:54.403455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:54.403441    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:26:55.380474 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:55.380446    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:26:55.411442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:55.411400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" event={"ID":"9c153c1e-8d48-48e8-91ca-72007c5f97a6","Type":"ContainerStarted","Data":"2d988b3020e823d4c7631937fca9c5152828c0a5bb54612b6f044bfcde0f8563"}
Sep 11 18:26:55.462137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:55.462109    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:26:55.463113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:55.463080    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-v7wzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:26:55.463417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:55.463379    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podUID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:26:56.373151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:56.373106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:56.462379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:56.462330    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-v7wzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:26:56.462897 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:56.462400    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podUID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:26:56.469100 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:56.469068    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:26:56.813032 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:56.812994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:26:57.462513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:57.462465    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-v7wzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:26:57.463030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:57.462550    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podUID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:26:58.462786 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:58.462739    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-v7wzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:26:58.463327 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:58.462816    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podUID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:26:59.462749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:59.462710    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-v7wzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:26:59.463062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:26:59.463028    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podUID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:27:00.377114 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:00.377086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wwts9"
Sep 11 18:27:00.462277 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:00.462237    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-v7wzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 18:27:00.462487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:00.462321    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs" podUID="9c153c1e-8d48-48e8-91ca-72007c5f97a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 18:27:01.466317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:01.466270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:27:01.467529 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:01.467505    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs"
Sep 11 18:27:10.084482 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:10.084442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:27:36.137948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.137915    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"]
Sep 11 18:27:36.140904 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.140879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.145008 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.144987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 18:27:36.145130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.145020    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6klqx\""
Sep 11 18:27:36.145130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.144987    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 18:27:36.145130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.145025    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 18:27:36.153237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.153216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"]
Sep 11 18:27:36.184116 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.184083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:27:36.241703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.241675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.241837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.241747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.241837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.241774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.241837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.241809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.241945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.241865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.241945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.241890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmm5n\" (UniqueName: \"kubernetes.io/projected/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-kube-api-access-xmm5n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.342896 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.342860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.342896 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.342897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmm5n\" (UniqueName: \"kubernetes.io/projected/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-kube-api-access-xmm5n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.342954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.342975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.342992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.343027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.343442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343529 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.343479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.343567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.343542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.345212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.345191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.345537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.345520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.351431 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.351409    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmm5n\" (UniqueName: \"kubernetes.io/projected/fb704224-cfb4-4b9c-bf23-b8ec5ee53425-kube-api-access-xmm5n\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fm6qh\" (UID: \"fb704224-cfb4-4b9c-bf23-b8ec5ee53425\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.454968 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.454902    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:36.731382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:36.731355    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"]
Sep 11 18:27:36.732345 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:27:36.732295    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb704224_cfb4_4b9c_bf23_b8ec5ee53425.slice/crio-69fb7a2103fbfd04e61d7924b581da81fbaf962f8e1b5af41dc9c8c53325f97c WatchSource:0}: Error finding container 69fb7a2103fbfd04e61d7924b581da81fbaf962f8e1b5af41dc9c8c53325f97c: Status 404 returned error can't find the container with id 69fb7a2103fbfd04e61d7924b581da81fbaf962f8e1b5af41dc9c8c53325f97c
Sep 11 18:27:37.675141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:37.675102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh" event={"ID":"fb704224-cfb4-4b9c-bf23-b8ec5ee53425","Type":"ContainerStarted","Data":"69fb7a2103fbfd04e61d7924b581da81fbaf962f8e1b5af41dc9c8c53325f97c"}
Sep 11 18:27:38.682421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:38.682386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh" event={"ID":"fb704224-cfb4-4b9c-bf23-b8ec5ee53425","Type":"ContainerStarted","Data":"df834debf87f694af51f9e480b3a9456608b4f79a54f4fd753e4612873e9c0ab"}
Sep 11 18:27:38.700633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:38.700586    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh" podStartSLOduration=1.731583514 podStartE2EDuration="2.700573464s" totalImagesPullingTime="968.98995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:27:38.697782106 +0000 UTC m=+701.272885574" watchObservedRunningTime="2026-09-11 18:27:38.700573464 +0000 UTC m=+701.275676967"
Sep 11 18:27:45.171978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:45.171946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:27:46.455367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:46.455334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:46.455847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:46.455394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:46.468022 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:46.467995    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:46.756005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:46.755977    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fm6qh"
Sep 11 18:27:51.779467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:51.779360    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:27:54.231334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.231286    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"]
Sep 11 18:27:54.235157 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.235129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.237832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.237812    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 18:27:54.247658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.247632    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"]
Sep 11 18:27:54.259440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.259410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:27:54.318908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.318870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.319076 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.318941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9398c2d0-4531-4995-87ec-5baa824132e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.319076 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.318966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkj85\" (UniqueName: \"kubernetes.io/projected/9398c2d0-4531-4995-87ec-5baa824132e4-kube-api-access-rkj85\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.319076 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.319007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.319248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.319119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.319248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.319171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9398c2d0-4531-4995-87ec-5baa824132e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkj85\" (UniqueName: \"kubernetes.io/projected/9398c2d0-4531-4995-87ec-5baa824132e4-kube-api-access-rkj85\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420783 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420707    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.420783 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.420763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.422646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.422622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9398c2d0-4531-4995-87ec-5baa824132e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.422934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.422916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9398c2d0-4531-4995-87ec-5baa824132e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.427798 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.427780    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkj85\" (UniqueName: \"kubernetes.io/projected/9398c2d0-4531-4995-87ec-5baa824132e4-kube-api-access-rkj85\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrcrq\" (UID: \"9398c2d0-4531-4995-87ec-5baa824132e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.548029 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.548001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:27:54.822418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:54.822388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"]
Sep 11 18:27:54.823644 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:27:54.823614    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9398c2d0_4531_4995_87ec_5baa824132e4.slice/crio-276794daba54a99aa13e7d9e5b48849b6308f0e22c77de19e365d79d99103927 WatchSource:0}: Error finding container 276794daba54a99aa13e7d9e5b48849b6308f0e22c77de19e365d79d99103927: Status 404 returned error can't find the container with id 276794daba54a99aa13e7d9e5b48849b6308f0e22c77de19e365d79d99103927
Sep 11 18:27:55.799646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:55.799604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq" event={"ID":"9398c2d0-4531-4995-87ec-5baa824132e4","Type":"ContainerStarted","Data":"0275ec27b9eea886b586027669c522216095c93a62b3d3721f0688f9394d510e"}
Sep 11 18:27:55.800119 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:55.799687    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq" event={"ID":"9398c2d0-4531-4995-87ec-5baa824132e4","Type":"ContainerStarted","Data":"276794daba54a99aa13e7d9e5b48849b6308f0e22c77de19e365d79d99103927"}
Sep 11 18:27:55.817342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:27:55.817280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq" podStartSLOduration=1.624131587 podStartE2EDuration="1.817266168s" totalImagesPullingTime="193.134581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:27:55.816502862 +0000 UTC m=+718.391606331" watchObservedRunningTime="2026-09-11 18:27:55.817266168 +0000 UTC m=+718.392369637"
Sep 11 18:28:00.267185 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:00.267147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:28:04.548838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:04.548804    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:28:04.549235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:04.548863    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:28:04.561379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:04.561357    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:28:04.865731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:04.865643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrcrq"
Sep 11 18:28:05.983322 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:05.983269    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:28:22.778618 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:22.778580    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:28:27.970602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:28:27.970570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:21.987058 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:21.986977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:33.198460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:33.198425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:33.302547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:33.302511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:34.391564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:34.391535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:34.487459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:34.487422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.325593 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.325554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.431467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.431436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.531989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.531955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.712689 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.712603    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.807635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.807577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.849095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.849065    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"]
Sep 11 18:29:51.853030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.853005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.856103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.856078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-b63ece-openshift-default-dockercfg-wdgxw\""
Sep 11 18:29:51.867960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.867935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"]
Sep 11 18:29:51.925254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.925221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:51.997235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q445k\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-kube-api-access-q445k\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54be3229-4537-4fa6-a249-355616de6418-istio-podinfo\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-istio-token\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-credential-socket\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-socket\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-data\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-envoy\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-certs\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:51.997630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:51.997535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54be3229-4537-4fa6-a249-355616de6418-istiod-ca-cert\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.083726 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.083689    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:52.098891 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.098860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-istio-token\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.098904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-credential-socket\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.098925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-socket\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.098949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-data\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-envoy\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-certs\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54be3229-4537-4fa6-a249-355616de6418-istiod-ca-cert\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099370 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q445k\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-kube-api-access-q445k\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099370 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-credential-socket\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099370 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-socket\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-data\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54be3229-4537-4fa6-a249-355616de6418-istio-podinfo\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-certs\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.099863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.099843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54be3229-4537-4fa6-a249-355616de6418-istiod-ca-cert\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.101537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.101510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-envoy\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.101754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.101736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54be3229-4537-4fa6-a249-355616de6418-istio-podinfo\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.115920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.115901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-istio-token\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.116475 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.116459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q445k\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-kube-api-access-q445k\") pod \"e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") " pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.164045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.164019    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:52.301553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.301514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:52.445926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.445901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"]
Sep 11 18:29:52.447724 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:29:52.447694    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54be3229_4537_4fa6_a249_355616de6418.slice/crio-8d147ddd21215f2a03ff8d23f4f0e2f48b3d81093bafb281826a48bfc868ff6f WatchSource:0}: Error finding container 8d147ddd21215f2a03ff8d23f4f0e2f48b3d81093bafb281826a48bfc868ff6f: Status 404 returned error can't find the container with id 8d147ddd21215f2a03ff8d23f4f0e2f48b3d81093bafb281826a48bfc868ff6f
Sep 11 18:29:52.449918 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.449879    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:29:52.450025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.449956    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:29:52.450025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.450000    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:29:52.500461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.500437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" event={"ID":"54be3229-4537-4fa6-a249-355616de6418","Type":"ContainerStarted","Data":"8d147ddd21215f2a03ff8d23f4f0e2f48b3d81093bafb281826a48bfc868ff6f"}
Sep 11 18:29:52.930929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:52.930887    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:53.028661 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.028629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:53.206706 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.206628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:53.307522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.307482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:53.451331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.451284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:53.508148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.508116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" event={"ID":"54be3229-4537-4fa6-a249-355616de6418","Type":"ContainerStarted","Data":"89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"}
Sep 11 18:29:53.531379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.531338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podStartSLOduration=2.531322586 podStartE2EDuration="2.531322586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:53.529969684 +0000 UTC m=+836.105073151" watchObservedRunningTime="2026-09-11 18:29:53.531322586 +0000 UTC m=+836.106426046"
Sep 11 18:29:53.610621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.610593    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7548-6a8587"]
Sep 11 18:29:53.614231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.614212    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:53.616671 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.616646    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t65h9\""
Sep 11 18:29:53.620293 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.620247    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7548-6a8587"]
Sep 11 18:29:53.714633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.714604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqknq\" (UniqueName: \"kubernetes.io/projected/17c2166a-2ae6-4def-a088-52d8e77a965b-kube-api-access-nqknq\") pod \"test-curl-7548-6a8587\" (UID: \"17c2166a-2ae6-4def-a088-52d8e77a965b\") " pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:53.815979 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.815889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqknq\" (UniqueName: \"kubernetes.io/projected/17c2166a-2ae6-4def-a088-52d8e77a965b-kube-api-access-nqknq\") pod \"test-curl-7548-6a8587\" (UID: \"17c2166a-2ae6-4def-a088-52d8e77a965b\") " pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:53.825495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.825468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqknq\" (UniqueName: \"kubernetes.io/projected/17c2166a-2ae6-4def-a088-52d8e77a965b-kube-api-access-nqknq\") pod \"test-curl-7548-6a8587\" (UID: \"17c2166a-2ae6-4def-a088-52d8e77a965b\") " pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:53.926908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:53.926875    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:54.165030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:54.164948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:54.169710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:54.169688    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:54.202451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:54.202431    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7548-6a8587"]
Sep 11 18:29:54.203824 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:29:54.203795    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17c2166a_2ae6_4def_a088_52d8e77a965b.slice/crio-1a6ed2373e67a707717d0207882e609ab919026d4ac3228475159020bb38abbf WatchSource:0}: Error finding container 1a6ed2373e67a707717d0207882e609ab919026d4ac3228475159020bb38abbf: Status 404 returned error can't find the container with id 1a6ed2373e67a707717d0207882e609ab919026d4ac3228475159020bb38abbf
Sep 11 18:29:54.516764 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:54.516728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7548-6a8587" event={"ID":"17c2166a-2ae6-4def-a088-52d8e77a965b","Type":"ContainerStarted","Data":"1a6ed2373e67a707717d0207882e609ab919026d4ac3228475159020bb38abbf"}
Sep 11 18:29:54.517129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:54.517106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:54.518116 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:54.518093    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:29:55.524745 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:55.524707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7548-6a8587" event={"ID":"17c2166a-2ae6-4def-a088-52d8e77a965b","Type":"ContainerStarted","Data":"e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504"}
Sep 11 18:29:55.554350 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:55.554280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7548-6a8587" podStartSLOduration=1.831433664 podStartE2EDuration="2.554264504s" totalImagesPullingTime="722.83084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:55.551490216 +0000 UTC m=+838.126593687" watchObservedRunningTime="2026-09-11 18:29:55.554264504 +0000 UTC m=+838.129367971"
Sep 11 18:29:55.589635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:55.589596    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:55.683573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:55.683533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:56.353107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.353011    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7548-6a8587"]
Sep 11 18:29:56.358642 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.358609    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7548-6a8587"]
Sep 11 18:29:56.496701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.496663    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7548-487b1e"]
Sep 11 18:29:56.497378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.497355    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" containerName="test-curl-7548-6a8587"
Sep 11 18:29:56.497457 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.497381    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" containerName="test-curl-7548-6a8587"
Sep 11 18:29:56.497535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.497524    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" containerName="test-curl-7548-6a8587"
Sep 11 18:29:56.501347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.501324    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:56.512145 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.510804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7548-487b1e"]
Sep 11 18:29:56.531692 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:29:56.531661    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7548-6a8587" container="test-curl-7548-6a8587"
Sep 11 18:29:56.544332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.544286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gft\" (UniqueName: \"kubernetes.io/projected/22567b01-3ba2-4d3b-bfc1-03a92a29b74f-kube-api-access-w7gft\") pod \"test-curl-7548-487b1e\" (UID: \"22567b01-3ba2-4d3b-bfc1-03a92a29b74f\") " pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:56.645548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.645458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gft\" (UniqueName: \"kubernetes.io/projected/22567b01-3ba2-4d3b-bfc1-03a92a29b74f-kube-api-access-w7gft\") pod \"test-curl-7548-487b1e\" (UID: \"22567b01-3ba2-4d3b-bfc1-03a92a29b74f\") " pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:56.655510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.655478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gft\" (UniqueName: \"kubernetes.io/projected/22567b01-3ba2-4d3b-bfc1-03a92a29b74f-kube-api-access-w7gft\") pod \"test-curl-7548-487b1e\" (UID: \"22567b01-3ba2-4d3b-bfc1-03a92a29b74f\") " pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:56.799062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.799018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:56.815430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.815400    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:56.903455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:56.901584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:57.113534 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.113501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:57.120093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.120069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7548-487b1e"]
Sep 11 18:29:57.121807 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:29:57.121780    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22567b01_3ba2_4d3b_bfc1_03a92a29b74f.slice/crio-f803255dc3a6a029481bb5fee3499c43e578640c571babfd818bcc482cb9bd15 WatchSource:0}: Error finding container f803255dc3a6a029481bb5fee3499c43e578640c571babfd818bcc482cb9bd15: Status 404 returned error can't find the container with id f803255dc3a6a029481bb5fee3499c43e578640c571babfd818bcc482cb9bd15
Sep 11 18:29:57.539668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.539633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7548-487b1e" event={"ID":"22567b01-3ba2-4d3b-bfc1-03a92a29b74f","Type":"ContainerStarted","Data":"da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c"}
Sep 11 18:29:57.539668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.539674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7548-487b1e" event={"ID":"22567b01-3ba2-4d3b-bfc1-03a92a29b74f","Type":"ContainerStarted","Data":"f803255dc3a6a029481bb5fee3499c43e578640c571babfd818bcc482cb9bd15"}
Sep 11 18:29:57.540122 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.539844    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7548-6a8587" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" containerName="test-curl-7548-6a8587" containerID="cri-o://e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504" gracePeriod=2
Sep 11 18:29:57.567548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.567521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:57.576644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.576595    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7548-487b1e" podStartSLOduration=1.576581201 podStartE2EDuration="1.576581201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:29:57.574405942 +0000 UTC m=+840.149509409" watchObservedRunningTime="2026-09-11 18:29:57.576581201 +0000 UTC m=+840.151684702"
Sep 11 18:29:57.576792 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:29:57.576700    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7548-6a8587\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:57.676161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:57.676127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:57.907076 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:29:57.906994    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7548-6a8587\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:58.167352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.167255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:58.299199 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.299154    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7548-487b1e"]
Sep 11 18:29:58.300921 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.300886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:58.307729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.307703    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7548-487b1e"]
Sep 11 18:29:58.443567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.443485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:58.545286 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:29:58.545257    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7548-487b1e" container="test-curl-7548-487b1e"
Sep 11 18:29:58.650336 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.650287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:58.987875 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:58.987838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:59.340955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.340921    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"]
Sep 11 18:29:59.341449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.341431    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" containerName="test-curl-7548-487b1e"
Sep 11 18:29:59.341557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.341451    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" containerName="test-curl-7548-487b1e"
Sep 11 18:29:59.341616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.341603    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" containerName="test-curl-7548-487b1e"
Sep 11 18:29:59.345021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.345001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.349378 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.349358    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-71b1c2-openshift-default-dockercfg-8jnhb\""
Sep 11 18:29:59.372691 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-certs\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.372779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-token\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.372779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-envoy\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.372872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-podinfo\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.372872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-data\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.372872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2681fcbe-a21c-40fd-964d-6e4a99742edf-istiod-ca-cert\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.372972 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-socket\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.373007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.372991    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-credential-socket\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.373054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.373041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsvpv\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-kube-api-access-fsvpv\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.379859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.379837    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"]
Sep 11 18:29:59.396929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.396898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:59.473948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.473906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-certs\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.473948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.473948    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-token\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474194 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.473985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-envoy\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474194 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-podinfo\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-data\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2681fcbe-a21c-40fd-964d-6e4a99742edf-istiod-ca-cert\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-socket\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-credential-socket\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-certs\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsvpv\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-kube-api-access-fsvpv\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-data\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474737 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474691    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-socket\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.474895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.474871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-credential-socket\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.475046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.475024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2681fcbe-a21c-40fd-964d-6e4a99742edf-istiod-ca-cert\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.476963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.476937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-envoy\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.477129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.477114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-podinfo\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.485827 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.485805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-token\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.507732 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.507704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsvpv\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-kube-api-access-fsvpv\") pod \"e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") " pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.552715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.552674    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7548-487b1e" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" containerName="test-curl-7548-487b1e" containerID="cri-o://da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c" gracePeriod=2
Sep 11 18:29:59.556187 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:29:59.556157    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7548-487b1e\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:59.609787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.609755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:29:59.656730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.656704    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:29:59.721216 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.721135    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:29:59.723658 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:29:59.723632    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7548-487b1e\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:29:59.777770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.777742    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqknq\" (UniqueName: \"kubernetes.io/projected/17c2166a-2ae6-4def-a088-52d8e77a965b-kube-api-access-nqknq\") pod \"17c2166a-2ae6-4def-a088-52d8e77a965b\" (UID: \"17c2166a-2ae6-4def-a088-52d8e77a965b\") "
Sep 11 18:29:59.779758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.779728    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17c2166a-2ae6-4def-a088-52d8e77a965b-kube-api-access-nqknq" (OuterVolumeSpecName: "kube-api-access-nqknq") pod "17c2166a-2ae6-4def-a088-52d8e77a965b" (UID: "17c2166a-2ae6-4def-a088-52d8e77a965b"). InnerVolumeSpecName "kube-api-access-nqknq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:29:59.879558 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.879474    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqknq\" (UniqueName: \"kubernetes.io/projected/17c2166a-2ae6-4def-a088-52d8e77a965b-kube-api-access-nqknq\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:29:59.908580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.908547    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17c2166a-2ae6-4def-a088-52d8e77a965b" path="/var/lib/kubelet/pods/17c2166a-2ae6-4def-a088-52d8e77a965b/volumes"
Sep 11 18:29:59.944734 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.944708    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"]
Sep 11 18:29:59.946860 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:29:59.946833    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2681fcbe_a21c_40fd_964d_6e4a99742edf.slice/crio-9f2d919beda182d0703cb1615ef1124a6a2610d0826505cc210b8eefb8c0353d WatchSource:0}: Error finding container 9f2d919beda182d0703cb1615ef1124a6a2610d0826505cc210b8eefb8c0353d: Status 404 returned error can't find the container with id 9f2d919beda182d0703cb1615ef1124a6a2610d0826505cc210b8eefb8c0353d
Sep 11 18:29:59.949351 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.949264    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:29:59.949418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.949371    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:29:59.949418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:29:59.949409    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:00.081262 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.081224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:00.164458 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.164374    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"]
Sep 11 18:30:00.168920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.168899    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"
Sep 11 18:30:00.171337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.171313    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:30:00.180712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.180524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"
Sep 11 18:30:00.183715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.183596    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"]
Sep 11 18:30:00.466586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.466559    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"]
Sep 11 18:30:00.467486 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:30:00.467463    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35a0b21_819d_44be_a58e_7517cf62a858.slice/crio-34c6a695c5f4047ae7d1924bc3f891991f83f99bd9a85e06f08f22b0417a3fb0 WatchSource:0}: Error finding container 34c6a695c5f4047ae7d1924bc3f891991f83f99bd9a85e06f08f22b0417a3fb0: Status 404 returned error can't find the container with id 34c6a695c5f4047ae7d1924bc3f891991f83f99bd9a85e06f08f22b0417a3fb0
Sep 11 18:30:00.560326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.560265    2561 generic.go:356] "Generic (PLEG): container finished" podID="17c2166a-2ae6-4def-a088-52d8e77a965b" containerID="e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504" exitCode=137
Sep 11 18:30:00.560765 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.560335    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-6a8587"
Sep 11 18:30:00.560765 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.560346    2561 scope.go:117] "RemoveContainer" containerID="e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504"
Sep 11 18:30:00.562567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.562269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" event={"ID":"2681fcbe-a21c-40fd-964d-6e4a99742edf","Type":"ContainerStarted","Data":"7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"}
Sep 11 18:30:00.562567 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.562419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" event={"ID":"2681fcbe-a21c-40fd-964d-6e4a99742edf","Type":"ContainerStarted","Data":"9f2d919beda182d0703cb1615ef1124a6a2610d0826505cc210b8eefb8c0353d"}
Sep 11 18:30:00.564012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.563992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerStarted","Data":"34c6a695c5f4047ae7d1924bc3f891991f83f99bd9a85e06f08f22b0417a3fb0"}
Sep 11 18:30:00.569747 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.569731    2561 scope.go:117] "RemoveContainer" containerID="e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504"
Sep 11 18:30:00.569991 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:00.569972    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504\": container with ID starting with e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504 not found: ID does not exist" containerID="e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504"
Sep 11 18:30:00.570052 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.569999    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504"} err="failed to get container status \"e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504\": rpc error: code = NotFound desc = could not find container \"e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504\": container with ID starting with e5550c0a8be72d39a26438f859980abeefa32f7c94150fea78a2b9f3b076c504 not found: ID does not exist"
Sep 11 18:30:00.595175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.595127    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podStartSLOduration=1.5951090479999999 podStartE2EDuration="1.595109048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:00.590747588 +0000 UTC m=+843.165851056" watchObservedRunningTime="2026-09-11 18:30:00.595109048 +0000 UTC m=+843.170212516"
Sep 11 18:30:00.657341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:00.657297    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:01.124987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.124952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"]
Sep 11 18:30:01.130813 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.130791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.133583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.133563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-c8b274-serving-cert\""
Sep 11 18:30:01.143406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.143383    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"]
Sep 11 18:30:01.177998 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.177971    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:01.191131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.191104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkn7b\" (UniqueName: \"kubernetes.io/projected/2ff06d2e-907e-490b-bc65-b0d7f88d928d-kube-api-access-nkn7b\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.191243 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.191189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.191243 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.191234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff06d2e-907e-490b-bc65-b0d7f88d928d-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.191333 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.191294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-metrics-certs\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.287939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.287903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:01.292217 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.292196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.292348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.292230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff06d2e-907e-490b-bc65-b0d7f88d928d-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.292348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.292276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-metrics-certs\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.292348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.292333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkn7b\" (UniqueName: \"kubernetes.io/projected/2ff06d2e-907e-490b-bc65-b0d7f88d928d-kube-api-access-nkn7b\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.292503 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:01.292360    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-serving-cert: secret "maas-api-e2e-worker-w3-c8b274-serving-cert" not found
Sep 11 18:30:01.292503 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:01.292431    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls podName:2ff06d2e-907e-490b-bc65-b0d7f88d928d nodeName:}" failed. No retries permitted until 2026-09-11 18:30:01.792412601 +0000 UTC m=+844.367516050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls") pod "maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" (UID: "2ff06d2e-907e-490b-bc65-b0d7f88d928d") : secret "maas-api-e2e-worker-w3-c8b274-serving-cert" not found
Sep 11 18:30:01.293011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.292990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff06d2e-907e-490b-bc65-b0d7f88d928d-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.294762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.294745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-metrics-certs\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.305474 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.305450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkn7b\" (UniqueName: \"kubernetes.io/projected/2ff06d2e-907e-490b-bc65-b0d7f88d928d-kube-api-access-nkn7b\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.438268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.438176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:01.665133 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.665098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:01.784784 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.784756    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:30:01.798968 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.798929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.801940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.801910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:01.900117 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.900081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7gft\" (UniqueName: \"kubernetes.io/projected/22567b01-3ba2-4d3b-bfc1-03a92a29b74f-kube-api-access-w7gft\") pod \"22567b01-3ba2-4d3b-bfc1-03a92a29b74f\" (UID: \"22567b01-3ba2-4d3b-bfc1-03a92a29b74f\") "
Sep 11 18:30:01.902945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.902911    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22567b01-3ba2-4d3b-bfc1-03a92a29b74f-kube-api-access-w7gft" (OuterVolumeSpecName: "kube-api-access-w7gft") pod "22567b01-3ba2-4d3b-bfc1-03a92a29b74f" (UID: "22567b01-3ba2-4d3b-bfc1-03a92a29b74f"). InnerVolumeSpecName "kube-api-access-w7gft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:01.914815 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.914779    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" path="/var/lib/kubelet/pods/22567b01-3ba2-4d3b-bfc1-03a92a29b74f/volumes"
Sep 11 18:30:01.981221 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:01.981129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:02.002126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.002074    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7gft\" (UniqueName: \"kubernetes.io/projected/22567b01-3ba2-4d3b-bfc1-03a92a29b74f-kube-api-access-w7gft\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:02.044822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.044791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:02.110184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.110141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:02.341074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.341047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"]
Sep 11 18:30:02.581182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.581148    2561 generic.go:356] "Generic (PLEG): container finished" podID="22567b01-3ba2-4d3b-bfc1-03a92a29b74f" containerID="da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c" exitCode=137
Sep 11 18:30:02.581406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.581191    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7548-487b1e"
Sep 11 18:30:02.581406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.581265    2561 scope.go:117] "RemoveContainer" containerID="da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c"
Sep 11 18:30:02.581841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.581763    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:02.582991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.582969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:02.742874 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.742789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:02.912755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:02.912727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:03.010129 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:30:03.010098    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff06d2e_907e_490b_bc65_b0d7f88d928d.slice/crio-53c832cb23daf474294d1ec77e63c3d6e4c91c957f65afd3f805f92c638c20cd WatchSource:0}: Error finding container 53c832cb23daf474294d1ec77e63c3d6e4c91c957f65afd3f805f92c638c20cd: Status 404 returned error can't find the container with id 53c832cb23daf474294d1ec77e63c3d6e4c91c957f65afd3f805f92c638c20cd
Sep 11 18:30:03.013285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.013258    2561 scope.go:117] "RemoveContainer" containerID="da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c"
Sep 11 18:30:03.013670 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:03.013642    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c\": container with ID starting with da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c not found: ID does not exist" containerID="da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c"
Sep 11 18:30:03.013784 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.013682    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c"} err="failed to get container status \"da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c\": rpc error: code = NotFound desc = could not find container \"da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c\": container with ID starting with da334dab0a5f45e63ff7f26e8110ca180150fec9349ea8ab8e193eabdc72ee2c not found: ID does not exist"
Sep 11 18:30:03.149501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.149474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:03.589852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.589817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerStarted","Data":"1951401db2d6a032254767bdf3f3b6b4c76ceb2e4ee08e9f1ed8fae8a412d657"}
Sep 11 18:30:03.591748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.591719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" event={"ID":"2ff06d2e-907e-490b-bc65-b0d7f88d928d","Type":"ContainerStarted","Data":"aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f"}
Sep 11 18:30:03.591911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.591765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" event={"ID":"2ff06d2e-907e-490b-bc65-b0d7f88d928d","Type":"ContainerStarted","Data":"53c832cb23daf474294d1ec77e63c3d6e4c91c957f65afd3f805f92c638c20cd"}
Sep 11 18:30:03.591911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.591795    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:03.634367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.634228    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" podStartSLOduration=1.028418964 podStartE2EDuration="3.634213829s" totalImagesPullingTime="2.605794865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:03.632829176 +0000 UTC m=+846.207932636" watchObservedRunningTime="2026-09-11 18:30:03.634213829 +0000 UTC m=+846.209317296"
Sep 11 18:30:03.693082 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.693029    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" podStartSLOduration=2.283087134 podStartE2EDuration="2.693014392s" totalImagesPullingTime="409.927258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:03.689433222 +0000 UTC m=+846.264536690" watchObservedRunningTime="2026-09-11 18:30:03.693014392 +0000 UTC m=+846.268117850"
Sep 11 18:30:03.698322 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.698260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:03.926348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:03.926244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:04.073092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.073055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:04.198926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.198834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:04.350876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.350838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:04.541545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.541510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:04.600480 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.600445    2561 generic.go:356] "Generic (PLEG): container finished" podID="e35a0b21-819d-44be-a58e-7517cf62a858" containerID="1951401db2d6a032254767bdf3f3b6b4c76ceb2e4ee08e9f1ed8fae8a412d657" exitCode=7
Sep 11 18:30:04.600627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.600529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerDied","Data":"1951401db2d6a032254767bdf3f3b6b4c76ceb2e4ee08e9f1ed8fae8a412d657"}
Sep 11 18:30:04.600695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.600672    2561 scope.go:117] "RemoveContainer" containerID="1951401db2d6a032254767bdf3f3b6b4c76ceb2e4ee08e9f1ed8fae8a412d657"
Sep 11 18:30:04.688167 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.688135    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"]
Sep 11 18:30:04.693436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.693415    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.696746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.696721    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-aa3ba758-openshift-default-dockercfg-fk47b\""
Sep 11 18:30:04.719768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.719745    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"]
Sep 11 18:30:04.734468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734447    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-credential-socket\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-token\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-data\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-socket\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b77b286-c19e-4220-b2a9-0d1894d75c97-istiod-ca-cert\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-certs\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlvd\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-kube-api-access-zwlvd\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-envoy\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.734872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.734828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-podinfo\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.758472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.758451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:04.837900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.837808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b77b286-c19e-4220-b2a9-0d1894d75c97-istiod-ca-cert\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.837900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.837853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-certs\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.837900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.837874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlvd\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-kube-api-access-zwlvd\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.837900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.837897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-envoy\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.837922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-podinfo\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.837972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-credential-socket\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-token\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-data\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-socket\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838531 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838274    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-certs\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b77b286-c19e-4220-b2a9-0d1894d75c97-istiod-ca-cert\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838818 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838708    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-socket\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838818 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-credential-socket\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.838818 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.838759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-data\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.840283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.840262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-envoy\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.840669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.840651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-podinfo\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.863990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.863952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlvd\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-kube-api-access-zwlvd\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:04.865191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:04.865164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-token\") pod \"e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") " pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:05.004855 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.004808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:05.179716 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.179562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:05.323314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.323267    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"]
Sep 11 18:30:05.324977 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:30:05.324952    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b77b286_c19e_4220_b2a9_0d1894d75c97.slice/crio-a44a05b9d174aa4f91cca3ceca67f4cd3952faffd61bd7f19b9e636b5ce48b20 WatchSource:0}: Error finding container a44a05b9d174aa4f91cca3ceca67f4cd3952faffd61bd7f19b9e636b5ce48b20: Status 404 returned error can't find the container with id a44a05b9d174aa4f91cca3ceca67f4cd3952faffd61bd7f19b9e636b5ce48b20
Sep 11 18:30:05.327832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.327801    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:05.327919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.327875    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:05.327976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.327918    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:05.610158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.610052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" event={"ID":"1b77b286-c19e-4220-b2a9-0d1894d75c97","Type":"ContainerStarted","Data":"0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"}
Sep 11 18:30:05.610158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.610144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" event={"ID":"1b77b286-c19e-4220-b2a9-0d1894d75c97","Type":"ContainerStarted","Data":"a44a05b9d174aa4f91cca3ceca67f4cd3952faffd61bd7f19b9e636b5ce48b20"}
Sep 11 18:30:05.612512 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.612484    2561 generic.go:356] "Generic (PLEG): container finished" podID="e35a0b21-819d-44be-a58e-7517cf62a858" containerID="ecda8ff5447a9b87cfbcdcd46c7d37cbacc31c17d4854a521a461a6aa0d9a3a0" exitCode=7
Sep 11 18:30:05.612640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.612622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerDied","Data":"ecda8ff5447a9b87cfbcdcd46c7d37cbacc31c17d4854a521a461a6aa0d9a3a0"}
Sep 11 18:30:05.612698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.612676    2561 scope.go:117] "RemoveContainer" containerID="1951401db2d6a032254767bdf3f3b6b4c76ceb2e4ee08e9f1ed8fae8a412d657"
Sep 11 18:30:05.612912 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.612894    2561 scope.go:117] "RemoveContainer" containerID="ecda8ff5447a9b87cfbcdcd46c7d37cbacc31c17d4854a521a461a6aa0d9a3a0"
Sep 11 18:30:05.613310 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:05.613272    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc_odh-ai-gateway-infra(e35a0b21-819d-44be-a58e-7517cf62a858)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" podUID="e35a0b21-819d-44be-a58e-7517cf62a858"
Sep 11 18:30:05.645237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.643280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podStartSLOduration=1.643262335 podStartE2EDuration="1.643262335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:05.641649109 +0000 UTC m=+848.216752588" watchObservedRunningTime="2026-09-11 18:30:05.643262335 +0000 UTC m=+848.218365804"
Sep 11 18:30:05.935177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:05.935145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:06.005619 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.005579    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:06.007105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.007084    2561 patch_prober.go:28] interesting pod/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:30:06.007174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.007132    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:30:06.043234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.043106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:06.232760 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.232669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:06.621237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.621203    2561 scope.go:117] "RemoveContainer" containerID="ecda8ff5447a9b87cfbcdcd46c7d37cbacc31c17d4854a521a461a6aa0d9a3a0"
Sep 11 18:30:06.621498 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:06.621477    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc_odh-ai-gateway-infra(e35a0b21-819d-44be-a58e-7517cf62a858)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" podUID="e35a0b21-819d-44be-a58e-7517cf62a858"
Sep 11 18:30:06.790372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.790339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:06.900276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:06.900188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:07.009998 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:07.009972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:07.175594 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:07.175497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:07.305576 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:07.305543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:07.627612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:07.627575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:07.628630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:07.628605    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:07.700549 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:07.700512    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:09.022526 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:09.022492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:09.606991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:09.606961    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:30:10.140648 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:10.140611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:10.413552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:10.413459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:10.940782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:10.940745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:11.043801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.043764    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"]
Sep 11 18:30:11.049572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.049548    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.050285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.050256    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:11.052785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.052762    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aa3ba758-serving-cert\""
Sep 11 18:30:11.061211 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.061184    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"]
Sep 11 18:30:11.120602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.120571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.120782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.120616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-metrics-certs\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.120782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.120736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef98c262-c675-4d53-b2c4-2beb40329b34-openshift-service-ca\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.120889 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.120827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvq8m\" (UniqueName: \"kubernetes.io/projected/ef98c262-c675-4d53-b2c4-2beb40329b34-kube-api-access-tvq8m\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.133696 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.133664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:11.222215 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.222128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvq8m\" (UniqueName: \"kubernetes.io/projected/ef98c262-c675-4d53-b2c4-2beb40329b34-kube-api-access-tvq8m\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.222672 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.222270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.222672 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.222297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-metrics-certs\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.222672 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.222379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef98c262-c675-4d53-b2c4-2beb40329b34-openshift-service-ca\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.222672 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:11.222420    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-serving-cert: secret "maas-api-e2e-ait-aa3ba758-serving-cert" not found
Sep 11 18:30:11.222672 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:11.222486    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls podName:ef98c262-c675-4d53-b2c4-2beb40329b34 nodeName:}" failed. No retries permitted until 2026-09-11 18:30:11.722470629 +0000 UTC m=+854.297574074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls") pod "maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" (UID: "ef98c262-c675-4d53-b2c4-2beb40329b34") : secret "maas-api-e2e-ait-aa3ba758-serving-cert" not found
Sep 11 18:30:11.222989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.222971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef98c262-c675-4d53-b2c4-2beb40329b34-openshift-service-ca\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.224829 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.224805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-metrics-certs\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.233807 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.233787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvq8m\" (UniqueName: \"kubernetes.io/projected/ef98c262-c675-4d53-b2c4-2beb40329b34-kube-api-access-tvq8m\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.380126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.380079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:11.645007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.644965    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:11.729089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.729048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.731638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.731612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls\") pod \"maas-api-e2e-ait-aa3ba758-5996d89d44-97czx\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:11.735806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.735770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:11.782688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.782658    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"]
Sep 11 18:30:11.786872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.786847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:11.789444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.789423    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-aa3ba758\""
Sep 11 18:30:11.789553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.789523    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-aa3ba758-dockercfg-rk8k6\""
Sep 11 18:30:11.797993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.797897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"]
Sep 11 18:30:11.932188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.932098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897bf198-3cdd-4b1a-84ca-0646e6c53a12-plugins-config-volume\") pod \"payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") " pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:11.932188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.932144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4j9\" (UniqueName: \"kubernetes.io/projected/897bf198-3cdd-4b1a-84ca-0646e6c53a12-kube-api-access-4b4j9\") pod \"payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") " pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:11.965199 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:11.965155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:12.034508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.034173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897bf198-3cdd-4b1a-84ca-0646e6c53a12-plugins-config-volume\") pod \"payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") " pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:12.034508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.034256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4j9\" (UniqueName: \"kubernetes.io/projected/897bf198-3cdd-4b1a-84ca-0646e6c53a12-kube-api-access-4b4j9\") pod \"payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") " pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:12.037791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.035402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897bf198-3cdd-4b1a-84ca-0646e6c53a12-plugins-config-volume\") pod \"payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") " pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:12.046448 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.046363    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b4j9\" (UniqueName: \"kubernetes.io/projected/897bf198-3cdd-4b1a-84ca-0646e6c53a12-kube-api-access-4b4j9\") pod \"payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") " pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:12.102920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.102881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:12.137614 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.137582    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:12.255080 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.255044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"]
Sep 11 18:30:12.256740 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:30:12.256710    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef98c262_c675_4d53_b2c4_2beb40329b34.slice/crio-a772cd1ccbe09856d8988ad8ab3f6fb2e22064b414be27fb80f37ac239a6e162 WatchSource:0}: Error finding container a772cd1ccbe09856d8988ad8ab3f6fb2e22064b414be27fb80f37ac239a6e162: Status 404 returned error can't find the container with id a772cd1ccbe09856d8988ad8ab3f6fb2e22064b414be27fb80f37ac239a6e162
Sep 11 18:30:12.388421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.388378    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"]
Sep 11 18:30:12.390057 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:30:12.390029    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897bf198_3cdd_4b1a_84ca_0646e6c53a12.slice/crio-15fa77221164fb5d1e9e1ed7cb2bf2783f07384397746d90ec6b500583bb7920 WatchSource:0}: Error finding container 15fa77221164fb5d1e9e1ed7cb2bf2783f07384397746d90ec6b500583bb7920: Status 404 returned error can't find the container with id 15fa77221164fb5d1e9e1ed7cb2bf2783f07384397746d90ec6b500583bb7920
Sep 11 18:30:12.660758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.660709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn" event={"ID":"897bf198-3cdd-4b1a-84ca-0646e6c53a12","Type":"ContainerStarted","Data":"62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380"}
Sep 11 18:30:12.660902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.660774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn" event={"ID":"897bf198-3cdd-4b1a-84ca-0646e6c53a12","Type":"ContainerStarted","Data":"15fa77221164fb5d1e9e1ed7cb2bf2783f07384397746d90ec6b500583bb7920"}
Sep 11 18:30:12.660902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.660806    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:12.662194 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.662166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" event={"ID":"ef98c262-c675-4d53-b2c4-2beb40329b34","Type":"ContainerStarted","Data":"a772cd1ccbe09856d8988ad8ab3f6fb2e22064b414be27fb80f37ac239a6e162"}
Sep 11 18:30:12.668791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.668765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:12.690870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.690825    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn" podStartSLOduration=1.690806089 podStartE2EDuration="1.690806089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:12.68835886 +0000 UTC m=+855.263462332" watchObservedRunningTime="2026-09-11 18:30:12.690806089 +0000 UTC m=+855.265909557"
Sep 11 18:30:12.875599 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.875569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:12.980360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:12.980253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:13.117409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.117366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:13.279851 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.279801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:13.547489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.547384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:13.649147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.649100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:13.670937 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.670898    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" event={"ID":"ef98c262-c675-4d53-b2c4-2beb40329b34","Type":"ContainerStarted","Data":"6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792"}
Sep 11 18:30:13.671159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.671133    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:13.696698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.696649    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" podStartSLOduration=2.309823201 podStartE2EDuration="2.696634582s" totalImagesPullingTime="386.811381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:13.695231096 +0000 UTC m=+856.270334561" watchObservedRunningTime="2026-09-11 18:30:13.696634582 +0000 UTC m=+856.271738074"
Sep 11 18:30:13.755227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:13.755189    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:14.617525 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.617490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:14.680224 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.680194    2561 generic.go:356] "Generic (PLEG): container finished" podID="54be3229-4537-4fa6-a249-355616de6418" containerID="89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2" exitCode=0
Sep 11 18:30:14.680430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.680274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" event={"ID":"54be3229-4537-4fa6-a249-355616de6418","Type":"ContainerDied","Data":"89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"}
Sep 11 18:30:14.680766 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.680748    2561 scope.go:117] "RemoveContainer" containerID="89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"
Sep 11 18:30:14.681909 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.681880    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:14.681963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.681950    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:14.681998 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:14.681981    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:15.695701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:15.695653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" event={"ID":"54be3229-4537-4fa6-a249-355616de6418","Type":"ContainerStarted","Data":"59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20"}
Sep 11 18:30:15.707855 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:15.707816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:16.013870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:16.013838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:16.164790 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:16.164754    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:30:16.165160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:16.165133    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:30:16.165353 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:16.165326    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 18:30:16.909830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:16.909738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:17.165506 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:17.165410    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:30:17.165792 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:17.165761    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 18:30:17.887820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:17.887770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:18.164972 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:18.164867    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:30:18.165476 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:18.164960    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 18:30:19.078326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:19.075273    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:19.164502 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:19.164458    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:30:19.164704 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:19.164535    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 18:30:19.241172 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:19.241135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:19.690461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:19.690428    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:20.091571 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:20.091526    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:20.164649 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:20.164606    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 18:30:20.164864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:20.164706    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 18:30:21.168417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.168386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:30:21.168858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.168837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:30:21.169599 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.169582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:30:21.172332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.172291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:21.432969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.432882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:21.634909 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.634870    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:21.798217 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.798171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:21.909575 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:21.909542    2561 scope.go:117] "RemoveContainer" containerID="ecda8ff5447a9b87cfbcdcd46c7d37cbacc31c17d4854a521a461a6aa0d9a3a0"
Sep 11 18:30:22.431417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:22.431335    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:22.749785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:22.749749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerStarted","Data":"daa5f1af561fee6da26214f870fa48167b9d240db32cd3bdcf19faf5811295f0"}
Sep 11 18:30:23.191724 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.191633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:23.504521 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.504487    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:23.673095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.673068    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:23.760437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.760353    2561 generic.go:356] "Generic (PLEG): container finished" podID="e35a0b21-819d-44be-a58e-7517cf62a858" containerID="daa5f1af561fee6da26214f870fa48167b9d240db32cd3bdcf19faf5811295f0" exitCode=0
Sep 11 18:30:23.760437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.760398    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerDied","Data":"daa5f1af561fee6da26214f870fa48167b9d240db32cd3bdcf19faf5811295f0"}
Sep 11 18:30:23.760707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.760456    2561 scope.go:117] "RemoveContainer" containerID="ecda8ff5447a9b87cfbcdcd46c7d37cbacc31c17d4854a521a461a6aa0d9a3a0"
Sep 11 18:30:23.815848 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.815810    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"]
Sep 11 18:30:23.947531 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:23.947496    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:24.291311 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.291274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:24.576976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.576877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:24.768758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.768720    2561 generic.go:356] "Generic (PLEG): container finished" podID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerID="7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb" exitCode=0
Sep 11 18:30:24.768949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.768802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" event={"ID":"2681fcbe-a21c-40fd-964d-6e4a99742edf","Type":"ContainerDied","Data":"7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"}
Sep 11 18:30:24.769386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.769363    2561 scope.go:117] "RemoveContainer" containerID="7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"
Sep 11 18:30:24.770609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.770575    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:24.770725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.770655    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:24.770725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.770694    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:24.937505 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:24.937478    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"
Sep 11 18:30:25.745610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.745571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:25.781687 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.781654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" event={"ID":"2681fcbe-a21c-40fd-964d-6e4a99742edf","Type":"ContainerStarted","Data":"6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651"}
Sep 11 18:30:25.783044 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.783024    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"
Sep 11 18:30:25.783191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.783020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc" event={"ID":"e35a0b21-819d-44be-a58e-7517cf62a858","Type":"ContainerDied","Data":"34c6a695c5f4047ae7d1924bc3f891991f83f99bd9a85e06f08f22b0417a3fb0"}
Sep 11 18:30:25.783191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.783167    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34c6a695c5f4047ae7d1924bc3f891991f83f99bd9a85e06f08f22b0417a3fb0"
Sep 11 18:30:25.940840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.940800    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"]
Sep 11 18:30:25.947453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:25.947418    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-b63ece-29819190-ddgxc"]
Sep 11 18:30:26.658041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:26.657995    2561 patch_prober.go:28] interesting pod/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 18:30:26.658263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:26.658063    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 18:30:26.658400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:26.658380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:27.588222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:27.588184    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:27.658037 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:27.657996    2561 patch_prober.go:28] interesting pod/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 18:30:27.658356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:27.658322    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 18:30:27.775344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:27.775291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:27.909981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:27.909897    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" path="/var/lib/kubelet/pods/e35a0b21-819d-44be-a58e-7517cf62a858/volumes"
Sep 11 18:30:27.967332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:27.967277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:28.229826 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:28.229744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:28.657550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:28.657505    2561 patch_prober.go:28] interesting pod/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 18:30:28.658066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:28.657576    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 18:30:29.657688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:29.657643    2561 patch_prober.go:28] interesting pod/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 18:30:29.658186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:29.657712    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 18:30:30.026089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:30.026050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:30.658164 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:30.658119    2561 patch_prober.go:28] interesting pod/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 18:30:30.658682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:30.658186    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 18:30:31.499830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:31.499789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:31.669412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:31.669380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:31.677154 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:31.671287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:31.678196 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:31.678171    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:30:32.622641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:32.622612    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:32.824349 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:32.824279    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:33.000136 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:33.000100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:33.244368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:33.244332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:33.464635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:33.464539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:34.638844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:34.638813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:35.461406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:35.461370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:35.566258 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:35.566221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:35.676506 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:35.676467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:36.147654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.147618    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:36.252551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.252514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:36.789901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.789864    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:36.869117 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.869080    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerID="0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e" exitCode=0
Sep 11 18:30:36.869319 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.869150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" event={"ID":"1b77b286-c19e-4220-b2a9-0d1894d75c97","Type":"ContainerDied","Data":"0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"}
Sep 11 18:30:36.869603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.869589    2561 scope.go:117] "RemoveContainer" containerID="0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"
Sep 11 18:30:36.870695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.870667    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:36.870759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.870750    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:36.870795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:36.870782    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:37.627682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:37.627653    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:37.770935 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:37.770900    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:37.879652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:37.879572    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" event={"ID":"1b77b286-c19e-4220-b2a9-0d1894d75c97","Type":"ContainerStarted","Data":"5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9"}
Sep 11 18:30:38.005328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:38.005280    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:38.006596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:38.006570    2561 patch_prober.go:28] interesting pod/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:30:38.006735 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:38.006627    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:30:38.690840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:38.690801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:39.005756 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:39.005723    2561 patch_prober.go:28] interesting pod/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:30:39.006199 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:39.005782    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:30:39.786654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:39.786617    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:40.005355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:40.005289    2561 patch_prober.go:28] interesting pod/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:30:40.005526 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:40.005387    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:30:40.305050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:40.305011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:40.417620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:40.417587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:40.634650 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:40.634557    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:41.006072 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:41.006041    2561 patch_prober.go:28] interesting pod/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:30:41.006225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:41.006094    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:30:41.521706 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:41.521672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.005917 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.005887    2561 patch_prober.go:28] interesting pod/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 18:30:42.006074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.005939    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 18:30:42.150950 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.150911    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"]
Sep 11 18:30:42.151462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.151426    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" podUID="ef98c262-c675-4d53-b2c4-2beb40329b34" containerName="maas-api" containerID="cri-o://6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792" gracePeriod=30
Sep 11 18:30:42.190691 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.190621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.221701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.221666    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"]
Sep 11 18:30:42.222030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.222000    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn" podUID="897bf198-3cdd-4b1a-84ca-0646e6c53a12" containerName="payload-processing" containerID="cri-o://62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380" gracePeriod=30
Sep 11 18:30:42.275336 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.274637    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.367459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.367050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.475355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.469815    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.517949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.517890    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:42.609466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.609439    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:42.609867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.609504    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvq8m\" (UniqueName: \"kubernetes.io/projected/ef98c262-c675-4d53-b2c4-2beb40329b34-kube-api-access-tvq8m\") pod \"ef98c262-c675-4d53-b2c4-2beb40329b34\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") "
Sep 11 18:30:42.609867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.609545    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-metrics-certs\") pod \"ef98c262-c675-4d53-b2c4-2beb40329b34\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") "
Sep 11 18:30:42.609867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.609629    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef98c262-c675-4d53-b2c4-2beb40329b34-openshift-service-ca\") pod \"ef98c262-c675-4d53-b2c4-2beb40329b34\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") "
Sep 11 18:30:42.609867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.609687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls\") pod \"ef98c262-c675-4d53-b2c4-2beb40329b34\" (UID: \"ef98c262-c675-4d53-b2c4-2beb40329b34\") "
Sep 11 18:30:42.610062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.610009    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef98c262-c675-4d53-b2c4-2beb40329b34-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef98c262-c675-4d53-b2c4-2beb40329b34" (UID: "ef98c262-c675-4d53-b2c4-2beb40329b34"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:30:42.610130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.610107    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef98c262-c675-4d53-b2c4-2beb40329b34-openshift-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:42.612292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.612265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef98c262-c675-4d53-b2c4-2beb40329b34" (UID: "ef98c262-c675-4d53-b2c4-2beb40329b34"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:30:42.612400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.612332    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ef98c262-c675-4d53-b2c4-2beb40329b34" (UID: "ef98c262-c675-4d53-b2c4-2beb40329b34"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:30:42.612400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.612381    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef98c262-c675-4d53-b2c4-2beb40329b34-kube-api-access-tvq8m" (OuterVolumeSpecName: "kube-api-access-tvq8m") pod "ef98c262-c675-4d53-b2c4-2beb40329b34" (UID: "ef98c262-c675-4d53-b2c4-2beb40329b34"). InnerVolumeSpecName "kube-api-access-tvq8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:42.622601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.622526    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.710908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.710875    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897bf198-3cdd-4b1a-84ca-0646e6c53a12-plugins-config-volume\") pod \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") "
Sep 11 18:30:42.711186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.710986    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b4j9\" (UniqueName: \"kubernetes.io/projected/897bf198-3cdd-4b1a-84ca-0646e6c53a12-kube-api-access-4b4j9\") pod \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\" (UID: \"897bf198-3cdd-4b1a-84ca-0646e6c53a12\") "
Sep 11 18:30:42.711331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.711285    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897bf198-3cdd-4b1a-84ca-0646e6c53a12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "897bf198-3cdd-4b1a-84ca-0646e6c53a12" (UID: "897bf198-3cdd-4b1a-84ca-0646e6c53a12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:30:42.711553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.711501    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvq8m\" (UniqueName: \"kubernetes.io/projected/ef98c262-c675-4d53-b2c4-2beb40329b34-kube-api-access-tvq8m\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:42.711553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.711527    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-metrics-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:42.711553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.711540    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef98c262-c675-4d53-b2c4-2beb40329b34-maas-api-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:42.711553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.711552    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897bf198-3cdd-4b1a-84ca-0646e6c53a12-plugins-config-volume\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:42.713837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.713814    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/897bf198-3cdd-4b1a-84ca-0646e6c53a12-kube-api-access-4b4j9" (OuterVolumeSpecName: "kube-api-access-4b4j9") pod "897bf198-3cdd-4b1a-84ca-0646e6c53a12" (UID: "897bf198-3cdd-4b1a-84ca-0646e6c53a12"). InnerVolumeSpecName "kube-api-access-4b4j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:42.812351 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.812265    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b4j9\" (UniqueName: \"kubernetes.io/projected/897bf198-3cdd-4b1a-84ca-0646e6c53a12-kube-api-access-4b4j9\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:42.826937 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.826905    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"]
Sep 11 18:30:42.827131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.827108    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy" containerID="cri-o://5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9" gracePeriod=30
Sep 11 18:30:42.858771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.858687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:42.915354 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.915317    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef98c262-c675-4d53-b2c4-2beb40329b34" containerID="6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792" exitCode=0
Sep 11 18:30:42.915554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.915363    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"
Sep 11 18:30:42.915554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.915381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" event={"ID":"ef98c262-c675-4d53-b2c4-2beb40329b34","Type":"ContainerDied","Data":"6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792"}
Sep 11 18:30:42.915554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.915448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx" event={"ID":"ef98c262-c675-4d53-b2c4-2beb40329b34","Type":"ContainerDied","Data":"a772cd1ccbe09856d8988ad8ab3f6fb2e22064b414be27fb80f37ac239a6e162"}
Sep 11 18:30:42.915554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.915483    2561 scope.go:117] "RemoveContainer" containerID="6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792"
Sep 11 18:30:42.917513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.917476    2561 generic.go:356] "Generic (PLEG): container finished" podID="897bf198-3cdd-4b1a-84ca-0646e6c53a12" containerID="62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380" exitCode=0
Sep 11 18:30:42.917513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.917511    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"
Sep 11 18:30:42.917699 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.917527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn" event={"ID":"897bf198-3cdd-4b1a-84ca-0646e6c53a12","Type":"ContainerDied","Data":"62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380"}
Sep 11 18:30:42.917699 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.917569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn" event={"ID":"897bf198-3cdd-4b1a-84ca-0646e6c53a12","Type":"ContainerDied","Data":"15fa77221164fb5d1e9e1ed7cb2bf2783f07384397746d90ec6b500583bb7920"}
Sep 11 18:30:42.931146 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.931123    2561 scope.go:117] "RemoveContainer" containerID="6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792"
Sep 11 18:30:42.931461 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:42.931441    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792\": container with ID starting with 6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792 not found: ID does not exist" containerID="6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792"
Sep 11 18:30:42.931547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.931468    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792"} err="failed to get container status \"6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792\": rpc error: code = NotFound desc = could not find container \"6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792\": container with ID starting with 6cab16a96496b3fe77ae06bea2230fa565af9e047032fcb949c9a05b0023e792 not found: ID does not exist"
Sep 11 18:30:42.931547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.931483    2561 scope.go:117] "RemoveContainer" containerID="62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380"
Sep 11 18:30:42.941786 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.941683    2561 scope.go:117] "RemoveContainer" containerID="62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380"
Sep 11 18:30:42.942013 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:42.941992    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380\": container with ID starting with 62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380 not found: ID does not exist" containerID="62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380"
Sep 11 18:30:42.942092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.942022    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380"} err="failed to get container status \"62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380\": rpc error: code = NotFound desc = could not find container \"62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380\": container with ID starting with 62cf3aa912c50518dea3586ab525adef78beb4b695aa3152f91745b1906b1380 not found: ID does not exist"
Sep 11 18:30:42.972320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.971598    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"]
Sep 11 18:30:42.972320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.971646    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa3ba758-5996d89d44-97czx"]
Sep 11 18:30:42.977978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.977567    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"]
Sep 11 18:30:42.980311 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:42.980276    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn"]
Sep 11 18:30:43.146776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.146691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:43.280528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.280494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:43.462954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.462865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:43.700382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700345    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"]
Sep 11 18:30:43.700829 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700813    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700833    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700853    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700860    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700869    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef98c262-c675-4d53-b2c4-2beb40329b34" containerName="maas-api"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700874    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef98c262-c675-4d53-b2c4-2beb40329b34" containerName="maas-api"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700897    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897bf198-3cdd-4b1a-84ca-0646e6c53a12" containerName="payload-processing"
Sep 11 18:30:43.700910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700903    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="897bf198-3cdd-4b1a-84ca-0646e6c53a12" containerName="payload-processing"
Sep 11 18:30:43.701272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700974    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef98c262-c675-4d53-b2c4-2beb40329b34" containerName="maas-api"
Sep 11 18:30:43.701272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700984    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:30:43.701272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.700992    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:30:43.701272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.701001    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="897bf198-3cdd-4b1a-84ca-0646e6c53a12" containerName="payload-processing"
Sep 11 18:30:43.704397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.704375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.707433 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.707410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0aacf4f7-gw-openshift-default-dockercfg-s8k6t\""
Sep 11 18:30:43.726278 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.726251    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"]
Sep 11 18:30:43.740414 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.740393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:43.824465 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-data\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824465 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-certs\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-istio-token\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17864c4f-7497-4396-8fe5-491609c1b91e-istiod-ca-cert\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-socket\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824734 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17864c4f-7497-4396-8fe5-491609c1b91e-istio-podinfo\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-envoy\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npfrm\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-kube-api-access-npfrm\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.824810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.824770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-credential-socket\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.877942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.877903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:43.912859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.912816    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="897bf198-3cdd-4b1a-84ca-0646e6c53a12" path="/var/lib/kubelet/pods/897bf198-3cdd-4b1a-84ca-0646e6c53a12/volumes"
Sep 11 18:30:43.913513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.913489    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef98c262-c675-4d53-b2c4-2beb40329b34" path="/var/lib/kubelet/pods/ef98c262-c675-4d53-b2c4-2beb40329b34/volumes"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.926782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-istio-token\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.926836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17864c4f-7497-4396-8fe5-491609c1b91e-istiod-ca-cert\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.926887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-socket\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.926935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17864c4f-7497-4396-8fe5-491609c1b91e-istio-podinfo\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.927013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-envoy\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.927040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npfrm\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-kube-api-access-npfrm\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.927086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-credential-socket\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.927143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-data\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.927173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-certs\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.927885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.927644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-certs\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.928710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.928680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17864c4f-7497-4396-8fe5-491609c1b91e-istiod-ca-cert\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.929205 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.929176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-credential-socket\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.929534 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.929515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-data\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.929799 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.929778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-socket\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.933999 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.933064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-envoy\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.933999 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.933473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17864c4f-7497-4396-8fe5-491609c1b91e-istio-podinfo\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.946983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.946955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npfrm\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-kube-api-access-npfrm\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:43.950964 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:43.950944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-istio-token\") pod \"e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") " pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:44.017927 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.017895    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:44.055332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.055289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:44.303294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.303263    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"]
Sep 11 18:30:44.304840 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:30:44.304804    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17864c4f_7497_4396_8fe5_491609c1b91e.slice/crio-e9a139fa6ab057acabe4c9f556ae47feb6fbc348d480850730dd16df2492b8be WatchSource:0}: Error finding container e9a139fa6ab057acabe4c9f556ae47feb6fbc348d480850730dd16df2492b8be: Status 404 returned error can't find the container with id e9a139fa6ab057acabe4c9f556ae47feb6fbc348d480850730dd16df2492b8be
Sep 11 18:30:44.312189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.312064    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:44.312189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.312159    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:44.312189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.312204    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:30:44.436147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.436108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:44.944472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.944437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" event={"ID":"17864c4f-7497-4396-8fe5-491609c1b91e","Type":"ContainerStarted","Data":"7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"}
Sep 11 18:30:44.944865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.944489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" event={"ID":"17864c4f-7497-4396-8fe5-491609c1b91e","Type":"ContainerStarted","Data":"e9a139fa6ab057acabe4c9f556ae47feb6fbc348d480850730dd16df2492b8be"}
Sep 11 18:30:44.969403 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:44.969344    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" podStartSLOduration=1.96932808 podStartE2EDuration="1.96932808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:30:44.966178174 +0000 UTC m=+887.541281643" watchObservedRunningTime="2026-09-11 18:30:44.96932808 +0000 UTC m=+887.544431547"
Sep 11 18:30:45.018248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:45.018222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:45.023581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:45.023555    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:45.394264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:45.394226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:45.951031 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:45.950997    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:45.951940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:45.951916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:30:46.224991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:46.224911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:46.547641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:46.547599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:46.650574 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:46.650534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:47.216261 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:47.216226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:48.205078 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.205041    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:48.596933 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.596909    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:48.677662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677637    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-token\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677667    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-envoy\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677721    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-podinfo\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-certs\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677777    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwlvd\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-kube-api-access-zwlvd\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b77b286-c19e-4220-b2a9-0d1894d75c97-istiod-ca-cert\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677838    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-credential-socket\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.677876 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-data\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.678123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.677928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-socket\") pod \"1b77b286-c19e-4220-b2a9-0d1894d75c97\" (UID: \"1b77b286-c19e-4220-b2a9-0d1894d75c97\") "
Sep 11 18:30:48.678322 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678272    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:48.678423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678296    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b77b286-c19e-4220-b2a9-0d1894d75c97-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:30:48.678423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678406    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.678546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678426    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b77b286-c19e-4220-b2a9-0d1894d75c97-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.678546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678423    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:48.678546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678517    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:48.678546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.678534    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:48.679932 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.679909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:30:48.680117 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.680103    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-kube-api-access-zwlvd" (OuterVolumeSpecName: "kube-api-access-zwlvd") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "kube-api-access-zwlvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:48.680366 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.680350    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:30:48.680433 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.680369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b77b286-c19e-4220-b2a9-0d1894d75c97" (UID: "1b77b286-c19e-4220-b2a9-0d1894d75c97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:30:48.779213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779190    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.779213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779212    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.779364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779221    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.779364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779231    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.779364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779239    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b77b286-c19e-4220-b2a9-0d1894d75c97-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.779364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779247    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwlvd\" (UniqueName: \"kubernetes.io/projected/1b77b286-c19e-4220-b2a9-0d1894d75c97-kube-api-access-zwlvd\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.779364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.779256    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b77b286-c19e-4220-b2a9-0d1894d75c97-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:30:48.977270 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.977234    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerID="5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9" exitCode=0
Sep 11 18:30:48.977479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.977279    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"
Sep 11 18:30:48.977479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.977339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" event={"ID":"1b77b286-c19e-4220-b2a9-0d1894d75c97","Type":"ContainerDied","Data":"5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9"}
Sep 11 18:30:48.977479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.977400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk" event={"ID":"1b77b286-c19e-4220-b2a9-0d1894d75c97","Type":"ContainerDied","Data":"a44a05b9d174aa4f91cca3ceca67f4cd3952faffd61bd7f19b9e636b5ce48b20"}
Sep 11 18:30:48.977479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.977432    2561 scope.go:117] "RemoveContainer" containerID="5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9"
Sep 11 18:30:48.989014 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.988992    2561 scope.go:117] "RemoveContainer" containerID="0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"
Sep 11 18:30:48.999015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.998996    2561 scope.go:117] "RemoveContainer" containerID="5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9"
Sep 11 18:30:48.999353 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:48.999288    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9\": container with ID starting with 5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9 not found: ID does not exist" containerID="5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9"
Sep 11 18:30:48.999461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.999360    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9"} err="failed to get container status \"5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9\": rpc error: code = NotFound desc = could not find container \"5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9\": container with ID starting with 5d31b335a623df0053900920eea9adc9756e8f91ce2f5817a6b8b73daaf1f1c9 not found: ID does not exist"
Sep 11 18:30:48.999461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.999386    2561 scope.go:117] "RemoveContainer" containerID="0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"
Sep 11 18:30:48.999703 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:30:48.999679    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e\": container with ID starting with 0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e not found: ID does not exist" containerID="0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"
Sep 11 18:30:48.999769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:48.999711    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e"} err="failed to get container status \"0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e\": rpc error: code = NotFound desc = could not find container \"0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e\": container with ID starting with 0cf1ea3c8a5f0f37bcf28e32ec8773e0f96b52ec555b11d69e3c4cfba7cca31e not found: ID does not exist"
Sep 11 18:30:49.001542 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.001517    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"]
Sep 11 18:30:49.005751 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.005729    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk"]
Sep 11 18:30:49.155690 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.155600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:49.231930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.231879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:49.676510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.676458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:49.771430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.771396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:49.910154 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:49.910124    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" path="/var/lib/kubelet/pods/1b77b286-c19e-4220-b2a9-0d1894d75c97/volumes"
Sep 11 18:30:50.246929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:50.246854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:51.164170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:51.164128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:51.262195 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:51.262160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:52.212421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:52.212373    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:52.348805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:52.348766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:53.776532 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:53.776502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:54.967674 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:54.967644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:56.072348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:56.072296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:57.138494 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:57.138461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:57.883963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:57.883936    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:30:57.884159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:57.884141    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:30:58.244618 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:58.244507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:59.143598 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:59.143560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:30:59.948560 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:30:59.948525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:00.868532 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:00.868495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:01.166799 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.166712    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"]
Sep 11 18:31:01.167367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167346    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy"
Sep 11 18:31:01.167422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167371    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy"
Sep 11 18:31:01.167422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167401    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:31:01.167422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167409    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:31:01.167516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167422    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy"
Sep 11 18:31:01.167516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167432    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy"
Sep 11 18:31:01.167585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167520    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e35a0b21-819d-44be-a58e-7517cf62a858" containerName="cleanup"
Sep 11 18:31:01.167585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy"
Sep 11 18:31:01.167585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.167543    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b77b286-c19e-4220-b2a9-0d1894d75c97" containerName="istio-proxy"
Sep 11 18:31:01.170759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.170741    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:01.173344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.173326    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:31:01.178506 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.178485    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"]
Sep 11 18:31:01.211978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.211950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2\" (UID: \"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:01.313405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.313369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2\" (UID: \"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:01.314049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.314025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2\" (UID: \"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:01.484339 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.484214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:01.760260 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.760230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"]
Sep 11 18:31:01.761763 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:31:01.761735    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cd6d18_b300_487c_a3ac_0cf5c3ac5e0e.slice/crio-6683ae277188846a853194ebb0cb221073b8e0aac79d7b95fa00b5e5b81660fe WatchSource:0}: Error finding container 6683ae277188846a853194ebb0cb221073b8e0aac79d7b95fa00b5e5b81660fe: Status 404 returned error can't find the container with id 6683ae277188846a853194ebb0cb221073b8e0aac79d7b95fa00b5e5b81660fe
Sep 11 18:31:01.843958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:01.843918    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:02.075801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:02.075761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2" event={"ID":"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e","Type":"ContainerStarted","Data":"147fa58b175f92fdfedbe4058228c9bd54604b05cf26c16b1e7e121955ddd99c"}
Sep 11 18:31:02.075993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:02.075824    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2" event={"ID":"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e","Type":"ContainerStarted","Data":"6683ae277188846a853194ebb0cb221073b8e0aac79d7b95fa00b5e5b81660fe"}
Sep 11 18:31:02.093175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:02.093128    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2" podStartSLOduration=1.093110783 podStartE2EDuration="1.093110783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:31:02.090531649 +0000 UTC m=+904.665635120" watchObservedRunningTime="2026-09-11 18:31:02.093110783 +0000 UTC m=+904.668214250"
Sep 11 18:31:02.640433 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:02.640399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:03.084094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:03.084055    2561 generic.go:356] "Generic (PLEG): container finished" podID="c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e" containerID="147fa58b175f92fdfedbe4058228c9bd54604b05cf26c16b1e7e121955ddd99c" exitCode=0
Sep 11 18:31:03.084252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:03.084110    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2" event={"ID":"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e","Type":"ContainerDied","Data":"147fa58b175f92fdfedbe4058228c9bd54604b05cf26c16b1e7e121955ddd99c"}
Sep 11 18:31:03.448092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:03.447990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:04.274198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:04.274166    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:04.367444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:04.367336    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e-maas-api-service-ca\") pod \"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e\" (UID: \"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e\") "
Sep 11 18:31:04.367828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:04.367783    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e" (UID: "c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:31:04.399912 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:04.399880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:04.468908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:04.468861    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:05.099479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:05.099448    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"
Sep 11 18:31:05.099479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:05.099472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2" event={"ID":"c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e","Type":"ContainerDied","Data":"6683ae277188846a853194ebb0cb221073b8e0aac79d7b95fa00b5e5b81660fe"}
Sep 11 18:31:05.099693 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:05.099515    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6683ae277188846a853194ebb0cb221073b8e0aac79d7b95fa00b5e5b81660fe"
Sep 11 18:31:05.148128 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:05.148086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:05.949603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:05.949541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:06.773955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:06.773917    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:10.108143 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:10.108101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:11.142225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.142188    2561 generic.go:356] "Generic (PLEG): container finished" podID="17864c4f-7497-4396-8fe5-491609c1b91e" containerID="7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270" exitCode=0
Sep 11 18:31:11.142636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.142257    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" event={"ID":"17864c4f-7497-4396-8fe5-491609c1b91e","Type":"ContainerDied","Data":"7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"}
Sep 11 18:31:11.142714 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.142698    2561 scope.go:117] "RemoveContainer" containerID="7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"
Sep 11 18:31:11.143790 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.143760    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:11.143857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.143831    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:11.143893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.143867    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:11.869616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.869585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:11.960565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:11.960485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:12.050075 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.050040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:12.106838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.106758    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"]
Sep 11 18:31:12.110104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.110077    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aacf4f7-l4xf2"]
Sep 11 18:31:12.118408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.118376    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:12.157984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.157871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" event={"ID":"17864c4f-7497-4396-8fe5-491609c1b91e","Type":"ContainerStarted","Data":"e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715"}
Sep 11 18:31:12.262326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.261790    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"]
Sep 11 18:31:12.276845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.276802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:12.660174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.660139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:12.755901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.755858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:12.982491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.982407    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"]
Sep 11 18:31:12.982965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.982947    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e" containerName="revoke-keys"
Sep 11 18:31:12.983106 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.982968    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e" containerName="revoke-keys"
Sep 11 18:31:12.983174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.983108    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e" containerName="revoke-keys"
Sep 11 18:31:12.985592 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.985567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:12.988133 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.988112    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1fc84f74-openshift-default-dockercfg-tr89s\""
Sep 11 18:31:12.996510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:12.996489    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"]
Sep 11 18:31:13.013893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.013858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:13.018741 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.018717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:31:13.019746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.019723    2561 patch_prober.go:28] interesting pod/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 11 18:31:13.019840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.019770    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 11 18:31:13.070750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.070713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-socket\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.070939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.070776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40d3da5c-7cb7-424b-821d-b6c67431b24e-istiod-ca-cert\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.070939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.070882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-credential-socket\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.070939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.070929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-token\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.071132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.070999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-certs\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.071132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.071029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-data\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.071132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.071098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c888j\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-kube-api-access-c888j\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.071667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.071142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-envoy\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.071667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.071227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-podinfo\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40d3da5c-7cb7-424b-821d-b6c67431b24e-istiod-ca-cert\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-credential-socket\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-token\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-certs\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-data\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c888j\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-kube-api-access-c888j\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-envoy\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-podinfo\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.172852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.172719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-socket\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.173347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.173213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-socket\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.173951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.173924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40d3da5c-7cb7-424b-821d-b6c67431b24e-istiod-ca-cert\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.174232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.174209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-credential-socket\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.176921 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.174908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-data\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.176921 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.175555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-certs\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.177514 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.177488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-envoy\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.178956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.178908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-podinfo\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.181061 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.180892    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy" containerID="cri-o://e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715" gracePeriod=30
Sep 11 18:31:13.182578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.182498    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c888j\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-kube-api-access-c888j\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.183026 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.182874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-token\") pod \"e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") " pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.299123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.299086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:13.524522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.524484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:13.601142 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.601116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"]
Sep 11 18:31:13.602700 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:31:13.602668    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d3da5c_7cb7_424b_821d_b6c67431b24e.slice/crio-7796b1339635f912904e955b7969e5bd0a94146997dc8956a8e336f00da84f52 WatchSource:0}: Error finding container 7796b1339635f912904e955b7969e5bd0a94146997dc8956a8e336f00da84f52: Status 404 returned error can't find the container with id 7796b1339635f912904e955b7969e5bd0a94146997dc8956a8e336f00da84f52
Sep 11 18:31:13.603273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.603242    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:13.605227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.605197    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:13.605290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.605262    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:13.605350 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.605288    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:13.910286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:13.910190    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e" path="/var/lib/kubelet/pods/c8cd6d18-b300-487c-a3ac-0cf5c3ac5e0e/volumes"
Sep 11 18:31:14.190054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:14.189968    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" event={"ID":"40d3da5c-7cb7-424b-821d-b6c67431b24e","Type":"ContainerStarted","Data":"79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"}
Sep 11 18:31:14.190054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:14.190032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" event={"ID":"40d3da5c-7cb7-424b-821d-b6c67431b24e","Type":"ContainerStarted","Data":"7796b1339635f912904e955b7969e5bd0a94146997dc8956a8e336f00da84f52"}
Sep 11 18:31:14.213604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:14.213556    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podStartSLOduration=2.213541002 podStartE2EDuration="2.213541002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:31:14.210727562 +0000 UTC m=+916.785831044" watchObservedRunningTime="2026-09-11 18:31:14.213541002 +0000 UTC m=+916.788644469"
Sep 11 18:31:14.299715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:14.299682    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:14.305777 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:14.305747    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:14.437161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:14.437119    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:15.196577 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:15.196538    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:15.197461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:15.197439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:15.373067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:15.373029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:15.591895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:15.591849    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:15.740934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:15.740901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:15.951184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:15.951086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:31:16.637285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:16.637249    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:17.742170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:17.742134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:18.566072 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:18.566032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:18.675272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:18.675239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:18.769502 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:18.769473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:19.078590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:19.078548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:19.173521 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:19.173481    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:19.520144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:19.520108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:20.234791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:20.234745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:21.024433 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:21.024400    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:21.866408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:21.866364    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:22.837055 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.837031    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:31:22.980582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980497    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17864c4f-7497-4396-8fe5-491609c1b91e-istiod-ca-cert\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.980582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980535    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-certs\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.980582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-envoy\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980712    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npfrm\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-kube-api-access-npfrm\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980752    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-credential-socket\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980793    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-data\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980862    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-socket\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980890    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980934    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17864c4f-7497-4396-8fe5-491609c1b91e-istio-podinfo\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17864c4f-7497-4396-8fe5-491609c1b91e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.980971    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-istio-token\") pod \"17864c4f-7497-4396-8fe5-491609c1b91e\" (UID: \"17864c4f-7497-4396-8fe5-491609c1b91e\") "
Sep 11 18:31:22.981159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-data" (OuterVolumeSpecName: "istio-data") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981250    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981485    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981498    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981508    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981517    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17864c4f-7497-4396-8fe5-491609c1b91e-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:22.981621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.981526    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:22.982899 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.982864    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:22.983019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.982925    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-kube-api-access-npfrm" (OuterVolumeSpecName: "kube-api-access-npfrm") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "kube-api-access-npfrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:31:22.983162 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.983142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17864c4f-7497-4396-8fe5-491609c1b91e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:31:22.983223 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:22.983163    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-istio-token" (OuterVolumeSpecName: "istio-token") pod "17864c4f-7497-4396-8fe5-491609c1b91e" (UID: "17864c4f-7497-4396-8fe5-491609c1b91e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:31:23.082801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.082761    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17864c4f-7497-4396-8fe5-491609c1b91e-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:23.082801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.082791    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:23.082801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.082801    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17864c4f-7497-4396-8fe5-491609c1b91e-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:23.082801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.082809    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npfrm\" (UniqueName: \"kubernetes.io/projected/17864c4f-7497-4396-8fe5-491609c1b91e-kube-api-access-npfrm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:23.256412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.256380    2561 generic.go:356] "Generic (PLEG): container finished" podID="17864c4f-7497-4396-8fe5-491609c1b91e" containerID="e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715" exitCode=0
Sep 11 18:31:23.256638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.256455    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"
Sep 11 18:31:23.256638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.256466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" event={"ID":"17864c4f-7497-4396-8fe5-491609c1b91e","Type":"ContainerDied","Data":"e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715"}
Sep 11 18:31:23.256638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.256528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44" event={"ID":"17864c4f-7497-4396-8fe5-491609c1b91e","Type":"ContainerDied","Data":"e9a139fa6ab057acabe4c9f556ae47feb6fbc348d480850730dd16df2492b8be"}
Sep 11 18:31:23.256638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.256550    2561 scope.go:117] "RemoveContainer" containerID="e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715"
Sep 11 18:31:23.267246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.267228    2561 scope.go:117] "RemoveContainer" containerID="7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"
Sep 11 18:31:23.276587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.276567    2561 scope.go:117] "RemoveContainer" containerID="e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715"
Sep 11 18:31:23.276854 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:31:23.276834    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715\": container with ID starting with e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715 not found: ID does not exist" containerID="e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715"
Sep 11 18:31:23.276908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.276863    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715"} err="failed to get container status \"e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715\": rpc error: code = NotFound desc = could not find container \"e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715\": container with ID starting with e8c4197ed80aa53e9be14bbc452cfea3ea5cbe8344dfebda3d118b7bb60d9715 not found: ID does not exist"
Sep 11 18:31:23.276908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.276879    2561 scope.go:117] "RemoveContainer" containerID="7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"
Sep 11 18:31:23.277125 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:31:23.277108    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270\": container with ID starting with 7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270 not found: ID does not exist" containerID="7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"
Sep 11 18:31:23.277184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.277135    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270"} err="failed to get container status \"7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270\": rpc error: code = NotFound desc = could not find container \"7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270\": container with ID starting with 7f8ec7840a5807df75c91ecdbc07859672b3ba6ba7070533754aeafd8b69f270 not found: ID does not exist"
Sep 11 18:31:23.288240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.288215    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"]
Sep 11 18:31:23.295441 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.295419    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44"]
Sep 11 18:31:23.908744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:23.908697    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" path="/var/lib/kubelet/pods/17864c4f-7497-4396-8fe5-491609c1b91e/volumes"
Sep 11 18:31:36.345637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:36.345610    2561 generic.go:356] "Generic (PLEG): container finished" podID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerID="79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8" exitCode=0
Sep 11 18:31:36.345948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:36.345685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" event={"ID":"40d3da5c-7cb7-424b-821d-b6c67431b24e","Type":"ContainerDied","Data":"79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"}
Sep 11 18:31:36.346150 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:36.346134    2561 scope.go:117] "RemoveContainer" containerID="79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"
Sep 11 18:31:36.347317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:36.347273    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:36.347373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:36.347363    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:36.347409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:36.347394    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:37.365210 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:37.365169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" event={"ID":"40d3da5c-7cb7-424b-821d-b6c67431b24e","Type":"ContainerStarted","Data":"562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5"}
Sep 11 18:31:38.299486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:38.299453    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:38.299750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:38.299727    2561 patch_prober.go:28] interesting pod/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:31:38.299820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:38.299782    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:31:39.299620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:39.299585    2561 patch_prober.go:28] interesting pod/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:31:39.300026 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:39.299651    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:31:40.300505 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:40.300464    2561 patch_prober.go:28] interesting pod/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:31:40.300941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:40.300531    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:31:41.129732 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.129693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:41.299845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.299810    2561 patch_prober.go:28] interesting pod/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:31:41.300019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.299875    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:31:41.304236 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.304206    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"]
Sep 11 18:31:41.304692 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.304679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy"
Sep 11 18:31:41.304692 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.304694    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy"
Sep 11 18:31:41.304790 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.304780    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy"
Sep 11 18:31:41.308216 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.308200    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:41.310838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.310817    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:31:41.317008 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.316984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"]
Sep 11 18:31:41.371033 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.370979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905dfbb5-ec01-4318-a015-9a48c94078dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg\" (UID: \"905dfbb5-ec01-4318-a015-9a48c94078dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:41.472970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.472878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905dfbb5-ec01-4318-a015-9a48c94078dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg\" (UID: \"905dfbb5-ec01-4318-a015-9a48c94078dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:41.473534 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.473513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905dfbb5-ec01-4318-a015-9a48c94078dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg\" (UID: \"905dfbb5-ec01-4318-a015-9a48c94078dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:41.620178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.620145    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:41.923601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:41.923574    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"]
Sep 11 18:31:41.925061 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:31:41.925036    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905dfbb5_ec01_4318_a015_9a48c94078dd.slice/crio-381a774b9fc698d0011c32f5d9461a049e922b4e1ba9ce217e8d63bd53c8864d WatchSource:0}: Error finding container 381a774b9fc698d0011c32f5d9461a049e922b4e1ba9ce217e8d63bd53c8864d: Status 404 returned error can't find the container with id 381a774b9fc698d0011c32f5d9461a049e922b4e1ba9ce217e8d63bd53c8864d
Sep 11 18:31:42.236556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:42.236423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:42.299815 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:42.299781    2561 patch_prober.go:28] interesting pod/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 11 18:31:42.299980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:42.299832    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 11 18:31:42.400283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:42.400243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg" event={"ID":"905dfbb5-ec01-4318-a015-9a48c94078dd","Type":"ContainerStarted","Data":"888ffe4b72256ce5b842d3f92245204bffefd90a25ba1b1a064fd1644dcc93bb"}
Sep 11 18:31:42.400703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:42.400333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg" event={"ID":"905dfbb5-ec01-4318-a015-9a48c94078dd","Type":"ContainerStarted","Data":"381a774b9fc698d0011c32f5d9461a049e922b4e1ba9ce217e8d63bd53c8864d"}
Sep 11 18:31:42.425001 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:42.424952    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg" podStartSLOduration=1.4249377939999999 podStartE2EDuration="1.424937794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:31:42.422248052 +0000 UTC m=+944.997351519" watchObservedRunningTime="2026-09-11 18:31:42.424937794 +0000 UTC m=+945.000041264"
Sep 11 18:31:43.178136 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.178098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:43.304169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.304134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:43.304492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.304474    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:43.305045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.305030    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:43.409207 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.409169    2561 generic.go:356] "Generic (PLEG): container finished" podID="905dfbb5-ec01-4318-a015-9a48c94078dd" containerID="888ffe4b72256ce5b842d3f92245204bffefd90a25ba1b1a064fd1644dcc93bb" exitCode=0
Sep 11 18:31:43.409606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.409245    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg" event={"ID":"905dfbb5-ec01-4318-a015-9a48c94078dd","Type":"ContainerDied","Data":"888ffe4b72256ce5b842d3f92245204bffefd90a25ba1b1a064fd1644dcc93bb"}
Sep 11 18:31:43.657529 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:43.657485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:44.125869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:44.125818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:44.561772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:44.561744    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:44.729156 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:44.729068    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905dfbb5-ec01-4318-a015-9a48c94078dd-maas-api-service-ca\") pod \"905dfbb5-ec01-4318-a015-9a48c94078dd\" (UID: \"905dfbb5-ec01-4318-a015-9a48c94078dd\") "
Sep 11 18:31:44.729428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:44.729406    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905dfbb5-ec01-4318-a015-9a48c94078dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "905dfbb5-ec01-4318-a015-9a48c94078dd" (UID: "905dfbb5-ec01-4318-a015-9a48c94078dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:31:44.829904 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:44.829870    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905dfbb5-ec01-4318-a015-9a48c94078dd-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:44.933582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:44.933548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:45.428365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:45.428335    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"
Sep 11 18:31:45.428535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:45.428324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg" event={"ID":"905dfbb5-ec01-4318-a015-9a48c94078dd","Type":"ContainerDied","Data":"381a774b9fc698d0011c32f5d9461a049e922b4e1ba9ce217e8d63bd53c8864d"}
Sep 11 18:31:45.428535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:45.428458    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="381a774b9fc698d0011c32f5d9461a049e922b4e1ba9ce217e8d63bd53c8864d"
Sep 11 18:31:45.634867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:45.634829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:46.334732 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:46.334689    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:47.058437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.058404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:47.779508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.779469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:47.856728 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.856697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:47.929711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.929676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:47.995326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.995264    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"]
Sep 11 18:31:47.998279 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.998254    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1fc84f74-k5lcg"]
Sep 11 18:31:47.999537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:47.999511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:48.428382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:48.428349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:49.108544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.108510    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"]
Sep 11 18:31:49.108709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.108688    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy" containerID="cri-o://562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5" gracePeriod=30
Sep 11 18:31:49.130832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.130796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:49.333066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.333031    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:49.572701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.572669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:49.882935 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.882836    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"]
Sep 11 18:31:49.883628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.883605    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy"
Sep 11 18:31:49.883628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.883627    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy"
Sep 11 18:31:49.883822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.883649    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905dfbb5-ec01-4318-a015-9a48c94078dd" containerName="revoke-keys"
Sep 11 18:31:49.883822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.883655    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="905dfbb5-ec01-4318-a015-9a48c94078dd" containerName="revoke-keys"
Sep 11 18:31:49.883822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.883742    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="905dfbb5-ec01-4318-a015-9a48c94078dd" containerName="revoke-keys"
Sep 11 18:31:49.883822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.883752    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="17864c4f-7497-4396-8fe5-491609c1b91e" containerName="istio-proxy"
Sep 11 18:31:49.887780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.887732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:49.891735 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.891712    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f924630a-openshift-default-dockercfg-mdsq5\""
Sep 11 18:31:49.906800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.906761    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:49.910207 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.910185    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="905dfbb5-ec01-4318-a015-9a48c94078dd" path="/var/lib/kubelet/pods/905dfbb5-ec01-4318-a015-9a48c94078dd/volumes"
Sep 11 18:31:49.910541 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:49.910521    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"]
Sep 11 18:31:50.087311 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrbnc\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-kube-api-access-rrbnc\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-certs\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-credential-socket\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istiod-ca-cert\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-envoy\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-podinfo\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-socket\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-data\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.087795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.087750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-token\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-podinfo\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-socket\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189399    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-data\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-token\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrbnc\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-kube-api-access-rrbnc\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-certs\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-credential-socket\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istiod-ca-cert\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-envoy\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-socket\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-data\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.189990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.189961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-certs\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.190130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.190014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-credential-socket\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.190410 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.190392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istiod-ca-cert\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.191817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.191799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-envoy\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.191868 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.191856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-podinfo\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.201525 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.201503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-token\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.201685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.201660    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrbnc\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-kube-api-access-rrbnc\") pod \"e2e-derive-f924630a-openshift-default-785cd468cb-srzbc\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") " pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.205269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.205247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:50.348585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.348548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:50.447746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.447666    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:50.487374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.487338    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"]
Sep 11 18:31:50.487991 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:31:50.487968    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f128bfd_0a36_4c63_b3e2_336eec35bf90.slice/crio-79a9e281f3b85a9fc04ce110e1de7c90d7a56f1d4ae42025db6f39470d09973f WatchSource:0}: Error finding container 79a9e281f3b85a9fc04ce110e1de7c90d7a56f1d4ae42025db6f39470d09973f: Status 404 returned error can't find the container with id 79a9e281f3b85a9fc04ce110e1de7c90d7a56f1d4ae42025db6f39470d09973f
Sep 11 18:31:50.490390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.490352    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:50.490504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.490422    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:50.490504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:50.490449    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:31:51.052536 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:51.052501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:51.470606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:51.470518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" event={"ID":"6f128bfd-0a36-4c63-b3e2-336eec35bf90","Type":"ContainerStarted","Data":"e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"}
Sep 11 18:31:51.470606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:51.470579    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" event={"ID":"6f128bfd-0a36-4c63-b3e2-336eec35bf90","Type":"ContainerStarted","Data":"79a9e281f3b85a9fc04ce110e1de7c90d7a56f1d4ae42025db6f39470d09973f"}
Sep 11 18:31:51.492703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:51.492654    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podStartSLOduration=2.492635655 podStartE2EDuration="2.492635655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:31:51.489794451 +0000 UTC m=+954.064897937" watchObservedRunningTime="2026-09-11 18:31:51.492635655 +0000 UTC m=+954.067739123"
Sep 11 18:31:51.814365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:51.814325    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:52.205546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:52.205461    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:52.210877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:52.210853    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:52.477041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:52.476961    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:52.477913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:52.477891    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:31:52.604143 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:52.604109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:52.927685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:52.927650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:53.033692 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:53.033663    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:53.519884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:53.519847    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:54.323679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.323640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:54.374675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.374615    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:54.432910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.432879    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-envoy\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.432922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c888j\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-kube-api-access-c888j\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.432949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-socket\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.432964    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-credential-socket\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.432983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-certs\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-podinfo\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-data\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40d3da5c-7cb7-424b-821d-b6c67431b24e-istiod-ca-cert\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433188    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-token\") pod \"40d3da5c-7cb7-424b-821d-b6c67431b24e\" (UID: \"40d3da5c-7cb7-424b-821d-b6c67431b24e\") "
Sep 11 18:31:54.433380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433247    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:54.433380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:54.433380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433297    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:54.433715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433473    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-data" (OuterVolumeSpecName: "istio-data") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:54.433715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433588    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d3da5c-7cb7-424b-821d-b6c67431b24e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:31:54.433715 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433706    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.433860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433724    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40d3da5c-7cb7-424b-821d-b6c67431b24e-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.433860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433738    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.433860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433752    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.433860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.433766    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.435243 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.435220    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-kube-api-access-c888j" (OuterVolumeSpecName: "kube-api-access-c888j") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "kube-api-access-c888j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:31:54.435384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.435262    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-token" (OuterVolumeSpecName: "istio-token") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:31:54.435384 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.435283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:31:54.435505 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.435483    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40d3da5c-7cb7-424b-821d-b6c67431b24e" (UID: "40d3da5c-7cb7-424b-821d-b6c67431b24e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:31:54.491908 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.491883    2561 generic.go:356] "Generic (PLEG): container finished" podID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerID="562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5" exitCode=0
Sep 11 18:31:54.492009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.491927    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"
Sep 11 18:31:54.492009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.491957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" event={"ID":"40d3da5c-7cb7-424b-821d-b6c67431b24e","Type":"ContainerDied","Data":"562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5"}
Sep 11 18:31:54.492099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.492028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6" event={"ID":"40d3da5c-7cb7-424b-821d-b6c67431b24e","Type":"ContainerDied","Data":"7796b1339635f912904e955b7969e5bd0a94146997dc8956a8e336f00da84f52"}
Sep 11 18:31:54.492099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.492050    2561 scope.go:117] "RemoveContainer" containerID="562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5"
Sep 11 18:31:54.503821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.503803    2561 scope.go:117] "RemoveContainer" containerID="79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"
Sep 11 18:31:54.516334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.516287    2561 scope.go:117] "RemoveContainer" containerID="562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5"
Sep 11 18:31:54.516630 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:31:54.516608    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5\": container with ID starting with 562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5 not found: ID does not exist" containerID="562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5"
Sep 11 18:31:54.516723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.516637    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5"} err="failed to get container status \"562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5\": rpc error: code = NotFound desc = could not find container \"562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5\": container with ID starting with 562151d869d07b319c17340d2f017fb7d1225d230c3fe3fd9ca2753996fd22f5 not found: ID does not exist"
Sep 11 18:31:54.516723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.516655    2561 scope.go:117] "RemoveContainer" containerID="79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"
Sep 11 18:31:54.516960 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:31:54.516942    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8\": container with ID starting with 79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8 not found: ID does not exist" containerID="79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"
Sep 11 18:31:54.517020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.516968    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8"} err="failed to get container status \"79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8\": rpc error: code = NotFound desc = could not find container \"79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8\": container with ID starting with 79ddda98b8b03c2c76acb7a642ec2a7d2c42bd7d6f7a33c5a3e6ef1e31888ce8 not found: ID does not exist"
Sep 11 18:31:54.518486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.518467    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"]
Sep 11 18:31:54.523057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.523035    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6"]
Sep 11 18:31:54.534973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.534945    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.534973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.534969    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.535148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.534985    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40d3da5c-7cb7-424b-821d-b6c67431b24e-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:54.535148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:54.534998    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c888j\" (UniqueName: \"kubernetes.io/projected/40d3da5c-7cb7-424b-821d-b6c67431b24e-kube-api-access-c888j\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:31:55.380213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:55.380183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:55.909083 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:55.909050    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" path="/var/lib/kubelet/pods/40d3da5c-7cb7-424b-821d-b6c67431b24e/volumes"
Sep 11 18:31:56.178836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:56.178751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:57.117956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:57.117922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:58.077117 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:58.077055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:58.180218 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:58.180169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:58.285361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:58.285330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:58.748797 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:58.748697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:31:58.859369 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:31:58.859322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:06.268231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:06.268199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:16.635067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:16.635036    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerID="e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427" exitCode=0
Sep 11 18:32:16.635513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:16.635118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" event={"ID":"6f128bfd-0a36-4c63-b3e2-336eec35bf90","Type":"ContainerDied","Data":"e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"}
Sep 11 18:32:16.635625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:16.635607    2561 scope.go:117] "RemoveContainer" containerID="e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"
Sep 11 18:32:16.636977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:16.636949    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:32:16.637047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:16.637022    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:32:16.637086 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:16.637058    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:32:17.643576 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:17.643531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" event={"ID":"6f128bfd-0a36-4c63-b3e2-336eec35bf90","Type":"ContainerStarted","Data":"0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035"}
Sep 11 18:32:18.205735 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:18.205702    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:32:18.206708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:18.206682    2561 patch_prober.go:28] interesting pod/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 11 18:32:18.206854 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:18.206736    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 11 18:32:19.206009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:19.205974    2561 patch_prober.go:28] interesting pod/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 11 18:32:19.206397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:19.206037    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 11 18:32:19.328963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:19.328917    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:20.206688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:20.206606    2561 patch_prober.go:28] interesting pod/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 11 18:32:20.206688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:20.206662    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 11 18:32:20.878289 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:20.878238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:21.205759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:21.205658    2561 patch_prober.go:28] interesting pod/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 11 18:32:21.205759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:21.205724    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 11 18:32:21.823230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:21.823189    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:22.206250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.206168    2561 patch_prober.go:28] interesting pod/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 11 18:32:22.206250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.206222    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 11 18:32:22.477965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.477883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:32:22.563432 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.563396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:22.788692 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.788660    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"]
Sep 11 18:32:22.789141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.789127    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy"
Sep 11 18:32:22.789189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.789142    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy"
Sep 11 18:32:22.789189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.789165    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy"
Sep 11 18:32:22.789189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.789171    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy"
Sep 11 18:32:22.789285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.789241    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy"
Sep 11 18:32:22.789285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.789252    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d3da5c-7cb7-424b-821d-b6c67431b24e" containerName="istio-proxy"
Sep 11 18:32:22.792688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.792669    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:22.795262 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.795234    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:32:22.800121 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.800100    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"]
Sep 11 18:32:22.931230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:22.931199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/494100e0-3b76-4627-ae84-5622a9bb8ade-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f924630a-4vfw9\" (UID: \"494100e0-3b76-4627-ae84-5622a9bb8ade\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:23.015993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.015959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:23.031997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.031968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/494100e0-3b76-4627-ae84-5622a9bb8ade-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f924630a-4vfw9\" (UID: \"494100e0-3b76-4627-ae84-5622a9bb8ade\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:23.032695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.032676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/494100e0-3b76-4627-ae84-5622a9bb8ade-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f924630a-4vfw9\" (UID: \"494100e0-3b76-4627-ae84-5622a9bb8ade\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:23.105675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.105572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:23.117680 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.117652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:23.210227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.210197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:32:23.211722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.211677    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:32:23.387419 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.387389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"]
Sep 11 18:32:23.388430 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:32:23.388404    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494100e0_3b76_4627_ae84_5622a9bb8ade.slice/crio-32b7998b8ca8fa32a0d129968cda2a2d22b3f6d472048beafa336e98a020cfbf WatchSource:0}: Error finding container 32b7998b8ca8fa32a0d129968cda2a2d22b3f6d472048beafa336e98a020cfbf: Status 404 returned error can't find the container with id 32b7998b8ca8fa32a0d129968cda2a2d22b3f6d472048beafa336e98a020cfbf
Sep 11 18:32:23.441971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.441948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:23.695293 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.695264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9" event={"ID":"494100e0-3b76-4627-ae84-5622a9bb8ade","Type":"ContainerStarted","Data":"6fa98d37ecee2750d0f92cd7bd4ccfe12f86efb7ce35ea8223af1c7113dbe56b"}
Sep 11 18:32:23.695416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.695344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9" event={"ID":"494100e0-3b76-4627-ae84-5622a9bb8ade","Type":"ContainerStarted","Data":"32b7998b8ca8fa32a0d129968cda2a2d22b3f6d472048beafa336e98a020cfbf"}
Sep 11 18:32:23.712359 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:23.712313    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9" podStartSLOduration=1.7122861980000001 podStartE2EDuration="1.712286198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:32:23.709846374 +0000 UTC m=+986.284949845" watchObservedRunningTime="2026-09-11 18:32:23.712286198 +0000 UTC m=+986.287389702"
Sep 11 18:32:24.237135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:24.237048    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:24.703597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:24.703563    2561 generic.go:356] "Generic (PLEG): container finished" podID="494100e0-3b76-4627-ae84-5622a9bb8ade" containerID="6fa98d37ecee2750d0f92cd7bd4ccfe12f86efb7ce35ea8223af1c7113dbe56b" exitCode=0
Sep 11 18:32:24.703809 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:24.703650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9" event={"ID":"494100e0-3b76-4627-ae84-5622a9bb8ade","Type":"ContainerDied","Data":"6fa98d37ecee2750d0f92cd7bd4ccfe12f86efb7ce35ea8223af1c7113dbe56b"}
Sep 11 18:32:24.926580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:24.926549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:25.693920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:25.693885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:25.853540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:25.853514    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:25.963439 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:25.963364    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/494100e0-3b76-4627-ae84-5622a9bb8ade-maas-api-service-ca\") pod \"494100e0-3b76-4627-ae84-5622a9bb8ade\" (UID: \"494100e0-3b76-4627-ae84-5622a9bb8ade\") "
Sep 11 18:32:25.963770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:25.963751    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/494100e0-3b76-4627-ae84-5622a9bb8ade-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "494100e0-3b76-4627-ae84-5622a9bb8ade" (UID: "494100e0-3b76-4627-ae84-5622a9bb8ade"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:32:26.064297 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:26.064252    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/494100e0-3b76-4627-ae84-5622a9bb8ade-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:26.381519 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:26.381471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:26.717749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:26.717668    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"
Sep 11 18:32:26.717749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:26.717697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9" event={"ID":"494100e0-3b76-4627-ae84-5622a9bb8ade","Type":"ContainerDied","Data":"32b7998b8ca8fa32a0d129968cda2a2d22b3f6d472048beafa336e98a020cfbf"}
Sep 11 18:32:26.717749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:26.717745    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32b7998b8ca8fa32a0d129968cda2a2d22b3f6d472048beafa336e98a020cfbf"
Sep 11 18:32:27.081211 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:27.081176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:27.692451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:27.692419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:28.052937 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:28.052898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:34.301276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:34.301239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:34.995327 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:34.995231    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.095880 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.095841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.197436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.197405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.297187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.297150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.304107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.304075    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"]
Sep 11 18:32:35.311127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.311103    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f924630a-4vfw9"]
Sep 11 18:32:35.419841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.419804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.468168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.468132    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"]
Sep 11 18:32:35.468424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.468397    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" containerID="cri-o://0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035" gracePeriod=30
Sep 11 18:32:35.505390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.505361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.872460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.872426    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:35.909797 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:35.909755    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494100e0-3b76-4627-ae84-5622a9bb8ade" path="/var/lib/kubelet/pods/494100e0-3b76-4627-ae84-5622a9bb8ade/volumes"
Sep 11 18:32:36.175346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:36.175223    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:36.274754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:36.274715    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:36.374823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:36.374779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:36.748449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:36.748416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:37.560348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:37.560275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:38.213847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:38.213806    2561 patch_prober.go:28] interesting pod/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:32:38.214041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:38.213882    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:32:38.909863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:38.909828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:39.226015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:39.225929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:39.922905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:39.922869    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:40.728596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.728540    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:32:40.815324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815273    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istiod-ca-cert\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-socket\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-podinfo\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815448    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-credential-socket\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-envoy\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-certs\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815657    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-data\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815711 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815704    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-token\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.815870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815705    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:32:40.815870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815730    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:32:40.815870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrbnc\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-kube-api-access-rrbnc\") pod \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\" (UID: \"6f128bfd-0a36-4c63-b3e2-336eec35bf90\") "
Sep 11 18:32:40.816089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815921    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:32:40.816089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.815985    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:32:40.816201 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.816181    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.816257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.816206    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.816257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.816210    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:32:40.816257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.816221    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.816257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.816234    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.817903 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.817818    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerID="0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035" exitCode=0
Sep 11 18:32:40.817903 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.817878    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"
Sep 11 18:32:40.818151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.817879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" event={"ID":"6f128bfd-0a36-4c63-b3e2-336eec35bf90","Type":"ContainerDied","Data":"0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035"}
Sep 11 18:32:40.818151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.818014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc" event={"ID":"6f128bfd-0a36-4c63-b3e2-336eec35bf90","Type":"ContainerDied","Data":"79a9e281f3b85a9fc04ce110e1de7c90d7a56f1d4ae42025db6f39470d09973f"}
Sep 11 18:32:40.818151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.818054    2561 scope.go:117] "RemoveContainer" containerID="0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035"
Sep 11 18:32:40.818390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.818175    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:32:40.818390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.818257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:32:40.818510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.818487    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:32:40.818723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.818700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-kube-api-access-rrbnc" (OuterVolumeSpecName: "kube-api-access-rrbnc") pod "6f128bfd-0a36-4c63-b3e2-336eec35bf90" (UID: "6f128bfd-0a36-4c63-b3e2-336eec35bf90"). InnerVolumeSpecName "kube-api-access-rrbnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:32:40.840580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.840560    2561 scope.go:117] "RemoveContainer" containerID="e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"
Sep 11 18:32:40.848988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.848968    2561 scope.go:117] "RemoveContainer" containerID="0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035"
Sep 11 18:32:40.849273 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:32:40.849253    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035\": container with ID starting with 0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035 not found: ID does not exist" containerID="0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035"
Sep 11 18:32:40.849343 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.849281    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035"} err="failed to get container status \"0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035\": rpc error: code = NotFound desc = could not find container \"0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035\": container with ID starting with 0bf06ad7f4e0174c3c770067a5bc6685b1b7ddd0c581d10c9956de8f6e55a035 not found: ID does not exist"
Sep 11 18:32:40.849343 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.849297    2561 scope.go:117] "RemoveContainer" containerID="e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"
Sep 11 18:32:40.849549 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:32:40.849536    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427\": container with ID starting with e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427 not found: ID does not exist" containerID="e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"
Sep 11 18:32:40.849586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.849555    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427"} err="failed to get container status \"e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427\": rpc error: code = NotFound desc = could not find container \"e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427\": container with ID starting with e6e628fe5f6246c655f85c07cc6663fe7044cbde5e55c6abcd58a616b9fc9427 not found: ID does not exist"
Sep 11 18:32:40.917069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.917044    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.917069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.917065    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.917202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.917075    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.917202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.917082    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrbnc\" (UniqueName: \"kubernetes.io/projected/6f128bfd-0a36-4c63-b3e2-336eec35bf90-kube-api-access-rrbnc\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:40.917202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:40.917091    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f128bfd-0a36-4c63-b3e2-336eec35bf90-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:32:41.140957 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:41.140922    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"]
Sep 11 18:32:41.145280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:41.145255    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc"]
Sep 11 18:32:41.914545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:41.914508    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" path="/var/lib/kubelet/pods/6f128bfd-0a36-4c63-b3e2-336eec35bf90/volumes"
Sep 11 18:32:42.564830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.564794    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"]
Sep 11 18:32:42.565265 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565251    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy"
Sep 11 18:32:42.565329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565267    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy"
Sep 11 18:32:42.565329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565281    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494100e0-3b76-4627-ae84-5622a9bb8ade" containerName="revoke-keys"
Sep 11 18:32:42.565329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565286    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="494100e0-3b76-4627-ae84-5622a9bb8ade" containerName="revoke-keys"
Sep 11 18:32:42.565329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565320    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy"
Sep 11 18:32:42.565329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565327    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy"
Sep 11 18:32:42.565484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565389    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy"
Sep 11 18:32:42.565484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565398    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="494100e0-3b76-4627-ae84-5622a9bb8ade" containerName="revoke-keys"
Sep 11 18:32:42.565484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.565404    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f128bfd-0a36-4c63-b3e2-336eec35bf90" containerName="istio-proxy"
Sep 11 18:32:42.570246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.570203    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.573139 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.573120    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-52b585\"/\"test-model-52b585-kserve-self-signed-certs\""
Sep 11 18:32:42.573987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.573969    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-52b585\"/\"kube-root-ca.crt\""
Sep 11 18:32:42.574139 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.573970    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-52b585\"/\"openshift-service-ca.crt\""
Sep 11 18:32:42.574139 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.574118    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-52b585\"/\"default-dockercfg-ff476\""
Sep 11 18:32:42.583207 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.583186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"]
Sep 11 18:32:42.600520 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.600489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:42.632758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.632733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-home\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.632861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.632762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-tmp-dir\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.632861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.632784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-dshm\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.632942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.632881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-model-cache\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.632942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.632934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmc85\" (UniqueName: \"kubernetes.io/projected/589a0591-17f6-4255-a182-7a742b9695ff-kube-api-access-kmc85\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.633012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.632978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/589a0591-17f6-4255-a182-7a742b9695ff-tls-certs\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.733771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.733735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-home\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.733771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.733771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-tmp-dir\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.733997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.733801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-dshm\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.733997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.733842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-model-cache\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.733997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.733895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmc85\" (UniqueName: \"kubernetes.io/projected/589a0591-17f6-4255-a182-7a742b9695ff-kube-api-access-kmc85\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.733997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.733943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/589a0591-17f6-4255-a182-7a742b9695ff-tls-certs\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.734230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.734203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-home\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.734230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.734220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-tmp-dir\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.734379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.734272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-model-cache\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.736092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.736072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-dshm\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.736397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.736381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/589a0591-17f6-4255-a182-7a742b9695ff-tls-certs\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.742856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.742836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmc85\" (UniqueName: \"kubernetes.io/projected/589a0591-17f6-4255-a182-7a742b9695ff-kube-api-access-kmc85\") pod \"test-model-52b585-kserve-c449f6bdc-xxn8p\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") " pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:42.881047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:42.880961    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:43.160228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:43.160193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"]
Sep 11 18:32:43.161892 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:32:43.161860    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod589a0591_17f6_4255_a182_7a742b9695ff.slice/crio-12483b5f5d02f16e1ca8ab57cf760901d076cd49600ccb0294d779662540ec46 WatchSource:0}: Error finding container 12483b5f5d02f16e1ca8ab57cf760901d076cd49600ccb0294d779662540ec46: Status 404 returned error can't find the container with id 12483b5f5d02f16e1ca8ab57cf760901d076cd49600ccb0294d779662540ec46
Sep 11 18:32:43.841847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:43.841808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p" event={"ID":"589a0591-17f6-4255-a182-7a742b9695ff","Type":"ContainerStarted","Data":"2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e"}
Sep 11 18:32:43.842197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:43.841857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p" event={"ID":"589a0591-17f6-4255-a182-7a742b9695ff","Type":"ContainerStarted","Data":"12483b5f5d02f16e1ca8ab57cf760901d076cd49600ccb0294d779662540ec46"}
Sep 11 18:32:43.864858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:43.864799    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p" podStartSLOduration=1.864784082 podStartE2EDuration="1.864784082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:32:43.861960744 +0000 UTC m=+1006.437064211" watchObservedRunningTime="2026-09-11 18:32:43.864784082 +0000 UTC m=+1006.439887551"
Sep 11 18:32:44.091776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:44.091743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:44.225779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:44.225685    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:44.317516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:44.317474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:44.417091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:44.417055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:44.764934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:44.764901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:32:52.881291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:52.881257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:52.881701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:52.881327    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:52.894434 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:52.894410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:32:52.917360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:32:52.917336    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:33:03.840984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:03.840943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:04.531895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:04.531855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:05.256923 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:05.256884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:05.438823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:05.438785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:06.124703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:06.124658    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:06.786215 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:06.786175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:07.471257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:07.471218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:10.675973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:10.675940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:13.477332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:13.477274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:13.577382 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:13.577350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:13.678118 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:13.678086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:13.779685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:13.779653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:14.018063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:14.018026    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:14.141463 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:14.141383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:14.838660 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:14.838617    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:15.751912 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:15.751882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:16.642668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:16.642639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:17.084091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:17.084053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:17.193472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:17.193430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:17.283275 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:17.283239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:17.383024 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:17.382903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:19.090738 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:19.090701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:22.188364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:22.188330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:24.932020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:24.931980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:25.196101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.196008    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"]
Sep 11 18:33:25.196279 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.196239    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy" containerID="cri-o://6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651" gracePeriod=30
Sep 11 18:33:25.223039 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.223005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:25.673608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.673576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:25.965766 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.965691    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"]
Sep 11 18:33:25.969412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.969377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:25.972243 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.972223    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-54fc63-openshift-default-dockercfg-jdtdc\""
Sep 11 18:33:25.982856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.982833    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"]
Sep 11 18:33:25.995983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:25.995955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:26.068816 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.068778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-podinfo\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.068831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-credential-socket\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.068911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-certs\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069009 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.068971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-envoy\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.069008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-data\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.069142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-token\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.069213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx64m\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-kube-api-access-kx64m\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.069256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istiod-ca-cert\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.069396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.069344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-socket\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.137764 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.137726    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:26.170524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-envoy\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-data\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-token\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx64m\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-kube-api-access-kx64m\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170843 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istiod-ca-cert\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170843 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-socket\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-podinfo\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.170948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-credential-socket\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.171061 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-certs\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.171061 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.170989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-data\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.171321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.171283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-socket\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.171516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.171290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-credential-socket\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.171605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.171401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-certs\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.171605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.171580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istiod-ca-cert\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.172780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.172760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-envoy\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.173167 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.173151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-podinfo\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.179152 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.179129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-token\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.179441 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.179424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx64m\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-kube-api-access-kx64m\") pod \"e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") " pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.281043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.281015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:26.561811 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.561783    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"]
Sep 11 18:33:26.563199 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:33:26.563169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf04adb_0f88_48e2_a2f0_93ab432b34e9.slice/crio-93874289f209dbb4d7edf59e0087f3ed6a9b0416db37c2b7e1acf317e1b29350 WatchSource:0}: Error finding container 93874289f209dbb4d7edf59e0087f3ed6a9b0416db37c2b7e1acf317e1b29350: Status 404 returned error can't find the container with id 93874289f209dbb4d7edf59e0087f3ed6a9b0416db37c2b7e1acf317e1b29350
Sep 11 18:33:26.565545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.565511    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:33:26.565645 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.565577    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:33:26.565645 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:26.565604    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:33:27.131791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:27.131754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" event={"ID":"6cf04adb-0f88-48e2-a2f0-93ab432b34e9","Type":"ContainerStarted","Data":"20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"}
Sep 11 18:33:27.132285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:27.131813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" event={"ID":"6cf04adb-0f88-48e2-a2f0-93ab432b34e9","Type":"ContainerStarted","Data":"93874289f209dbb4d7edf59e0087f3ed6a9b0416db37c2b7e1acf317e1b29350"}
Sep 11 18:33:27.154583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:27.154535    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podStartSLOduration=2.15451985 podStartE2EDuration="2.15451985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:33:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:33:27.151966392 +0000 UTC m=+1049.727069862" watchObservedRunningTime="2026-09-11 18:33:27.15451985 +0000 UTC m=+1049.729623317"
Sep 11 18:33:27.281492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:27.281460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:27.286650 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:27.286624    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:28.138182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:28.138146    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:28.139113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:28.139092    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:28.945780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:28.945746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:29.119180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:29.119144    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:29.215926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:29.215819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:29.770417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:29.770379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:30.446176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.446152    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:33:30.518002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.517975    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-certs\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518017    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-socket\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518048    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-data\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-envoy\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518198    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsvpv\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-kube-api-access-fsvpv\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-credential-socket\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518259    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2681fcbe-a21c-40fd-964d-6e4a99742edf-istiod-ca-cert\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518328    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:33:30.518544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518341    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-podinfo\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:33:30.518544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518429    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-data" (OuterVolumeSpecName: "istio-data") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:33:30.518544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518439    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-token\") pod \"2681fcbe-a21c-40fd-964d-6e4a99742edf\" (UID: \"2681fcbe-a21c-40fd-964d-6e4a99742edf\") "
Sep 11 18:33:30.518755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518734    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2681fcbe-a21c-40fd-964d-6e4a99742edf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:33:30.518835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518815    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2681fcbe-a21c-40fd-964d-6e4a99742edf-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.518898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518840    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.518898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518852    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.518898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518865    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.518898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.518865    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:33:30.520572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.520536    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:33:30.520725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.520626    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-kube-api-access-fsvpv" (OuterVolumeSpecName: "kube-api-access-fsvpv") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "kube-api-access-fsvpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:33:30.520926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.520864    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-token" (OuterVolumeSpecName: "istio-token") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:33:30.521018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.520946    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2681fcbe-a21c-40fd-964d-6e4a99742edf" (UID: "2681fcbe-a21c-40fd-964d-6e4a99742edf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:33:30.620059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.620020    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.620059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.620051    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsvpv\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-kube-api-access-fsvpv\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.620059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.620066    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2681fcbe-a21c-40fd-964d-6e4a99742edf-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.620333 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.620080    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.620333 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.620091    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2681fcbe-a21c-40fd-964d-6e4a99742edf-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:33:30.634258 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:30.634230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:31.158198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.158161    2561 generic.go:356] "Generic (PLEG): container finished" podID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerID="6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651" exitCode=0
Sep 11 18:33:31.158398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.158210    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"
Sep 11 18:33:31.158398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.158242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" event={"ID":"2681fcbe-a21c-40fd-964d-6e4a99742edf","Type":"ContainerDied","Data":"6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651"}
Sep 11 18:33:31.158398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.158297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4" event={"ID":"2681fcbe-a21c-40fd-964d-6e4a99742edf","Type":"ContainerDied","Data":"9f2d919beda182d0703cb1615ef1124a6a2610d0826505cc210b8eefb8c0353d"}
Sep 11 18:33:31.158398 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.158362    2561 scope.go:117] "RemoveContainer" containerID="6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651"
Sep 11 18:33:31.168921 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.168899    2561 scope.go:117] "RemoveContainer" containerID="7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"
Sep 11 18:33:31.178093 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.178074    2561 scope.go:117] "RemoveContainer" containerID="6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651"
Sep 11 18:33:31.178388 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:33:31.178369    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651\": container with ID starting with 6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651 not found: ID does not exist" containerID="6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651"
Sep 11 18:33:31.178484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.178399    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651"} err="failed to get container status \"6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651\": rpc error: code = NotFound desc = could not find container \"6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651\": container with ID starting with 6092d4f64b6fbe68488777c32cbb9e12eb1631c2d4851fa6a2c2694fb4e36651 not found: ID does not exist"
Sep 11 18:33:31.178484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.178423    2561 scope.go:117] "RemoveContainer" containerID="7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"
Sep 11 18:33:31.178667 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:33:31.178650    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb\": container with ID starting with 7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb not found: ID does not exist" containerID="7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"
Sep 11 18:33:31.178706 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.178673    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb"} err="failed to get container status \"7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb\": rpc error: code = NotFound desc = could not find container \"7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb\": container with ID starting with 7242e8b7ac82551608e54d134d717186c1ffb878570ee46508341021fe6685bb not found: ID does not exist"
Sep 11 18:33:31.185265 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.185244    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"]
Sep 11 18:33:31.189672 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.189651    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4"]
Sep 11 18:33:31.401053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.401019    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:31.910544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:31.910505    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" path="/var/lib/kubelet/pods/2681fcbe-a21c-40fd-964d-6e4a99742edf/volumes"
Sep 11 18:33:32.255198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:32.255165    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:32.312519 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:32.312484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:32.412925 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:32.412874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:32.812314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:32.812261    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:32.890470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:32.890432    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:33.149181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:33.149093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:38.690863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:38.690829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:38.934404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:38.934372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:39.118680 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:39.118648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:39.200679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:39.200645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:45.581939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:45.581893    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:45.632002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:45.631968    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:49.665109 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:49.665057    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:50.476844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:50.476733    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:53.311748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:53.311707    2561 generic.go:356] "Generic (PLEG): container finished" podID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerID="20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff" exitCode=0
Sep 11 18:33:53.312180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:53.311779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" event={"ID":"6cf04adb-0f88-48e2-a2f0-93ab432b34e9","Type":"ContainerDied","Data":"20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"}
Sep 11 18:33:53.312223 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:53.312202    2561 scope.go:117] "RemoveContainer" containerID="20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"
Sep 11 18:33:53.313401 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:53.313374    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:33:53.313478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:53.313442    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:33:53.313478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:53.313474    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:33:54.320063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:54.320028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" event={"ID":"6cf04adb-0f88-48e2-a2f0-93ab432b34e9","Type":"ContainerStarted","Data":"c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1"}
Sep 11 18:33:54.569487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:54.569435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:55.281204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:55.281162    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:55.282586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:55.282558    2561 patch_prober.go:28] interesting pod/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:33:55.282730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:55.282630    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 18:33:55.382657 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:55.382625    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:56.169774 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:56.169727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:56.281912 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:56.281873    2561 patch_prober.go:28] interesting pod/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:33:56.282091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:56.281948    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 18:33:56.834860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:56.834824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:56.905532 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:56.905495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:56.981822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:56.981789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:57.086090 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:57.085999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:57.180573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:57.180528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:57.281795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:57.281763    2561 patch_prober.go:28] interesting pod/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:33:57.281960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:57.281818    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 18:33:57.911055 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:57.911012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:58.010246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:58.010199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:58.114410 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:58.114380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:58.138270 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:58.138237    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:33:58.270835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:58.270798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:58.281924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:58.281888    2561 patch_prober.go:28] interesting pod/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:33:58.282095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:58.281948    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 18:33:59.228916 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:59.228875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:59.282218 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:59.282186    2561 patch_prober.go:28] interesting pod/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 18:33:59.282426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:59.282239    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 18:33:59.367126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:59.367092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:33:59.693753 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:33:59.693714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:00.285788 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:00.285754    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:34:00.286802 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:00.286784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:34:06.115416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:06.115377    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:06.237712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:06.237679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:06.773901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:06.773863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:12.873105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:12.873062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:12.973519 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:12.973479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:13.165385 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.165276    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:13.416633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.416530    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"]
Sep 11 18:34:13.417191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.417164    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy"
Sep 11 18:34:13.417346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.417252    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy"
Sep 11 18:34:13.417346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.417282    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy"
Sep 11 18:34:13.417346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.417292    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy"
Sep 11 18:34:13.417527 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.417494    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy"
Sep 11 18:34:13.420509 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.420487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.423103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.423084    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-489fe7a4-openshift-default-dockercfg-sfvkg\""
Sep 11 18:34:13.434824 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.434788    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"]
Sep 11 18:34:13.452987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.452938    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:13.578810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.578762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-certs\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.578814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7xk5\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-kube-api-access-t7xk5\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.578945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istiod-ca-cert\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579005 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.578978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-envoy\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.579097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-data\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.579145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-credential-socket\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579277 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.579191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-podinfo\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579277 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.579258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-socket\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.579401 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.579281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-token\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-token\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-certs\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7xk5\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-kube-api-access-t7xk5\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istiod-ca-cert\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-envoy\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-data\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-credential-socket\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-podinfo\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-socket\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-certs\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-credential-socket\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-data\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-socket\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.680922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.680895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istiod-ca-cert\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.682557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.682533    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-envoy\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.682819 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.682802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-podinfo\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.688978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.688954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-token\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.689072 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.688995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7xk5\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-kube-api-access-t7xk5\") pod \"e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") " pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.731857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.731812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:13.763707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:13.763672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:14.064320 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:34:14.064275    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1343d4f_1213_4e9b_a4fd_5b477695c7ed.slice/crio-1a57d1c2b2f8f93e8a93edc6a3ffbdb6296194259fd078ca16d9a05b1fcfb3dc WatchSource:0}: Error finding container 1a57d1c2b2f8f93e8a93edc6a3ffbdb6296194259fd078ca16d9a05b1fcfb3dc: Status 404 returned error can't find the container with id 1a57d1c2b2f8f93e8a93edc6a3ffbdb6296194259fd078ca16d9a05b1fcfb3dc
Sep 11 18:34:14.066888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.066849    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:34:14.067003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.066936    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:34:14.067003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.066984    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:34:14.150646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.150611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"]
Sep 11 18:34:14.464127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.464033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" event={"ID":"d1343d4f-1213-4e9b-a4fd-5b477695c7ed","Type":"ContainerStarted","Data":"eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"}
Sep 11 18:34:14.464127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.464084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" event={"ID":"d1343d4f-1213-4e9b-a4fd-5b477695c7ed","Type":"ContainerStarted","Data":"1a57d1c2b2f8f93e8a93edc6a3ffbdb6296194259fd078ca16d9a05b1fcfb3dc"}
Sep 11 18:34:14.492466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.492418    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podStartSLOduration=1.492401259 podStartE2EDuration="1.492401259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:34:14.490199597 +0000 UTC m=+1097.065303081" watchObservedRunningTime="2026-09-11 18:34:14.492401259 +0000 UTC m=+1097.067504727"
Sep 11 18:34:14.732170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:14.732092    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:15.738070 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:15.738040    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:15.834369 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:15.834337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:16.477064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:16.477034    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:16.477974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:16.477946    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:19.006549 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:19.006509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:19.735981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:19.735917    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:19.835246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:19.835200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:20.547193 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:20.547159    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:21.346103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:21.346034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:22.246578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:22.246541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:22.939828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:22.939788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:23.801938 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:23.801880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:23.876987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:23.876947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:23.979696 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:23.979660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:24.350395 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:24.350358    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:24.447079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:24.447048    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:36.049200 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:36.049162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:36.106980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:36.106940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:41.651039 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:41.651002    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerID="eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384" exitCode=0
Sep 11 18:34:41.651548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:41.651079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" event={"ID":"d1343d4f-1213-4e9b-a4fd-5b477695c7ed","Type":"ContainerDied","Data":"eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"}
Sep 11 18:34:41.651619 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:41.651591    2561 scope.go:117] "RemoveContainer" containerID="eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"
Sep 11 18:34:41.652835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:41.652803    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:34:41.652930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:41.652883    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:34:41.652930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:41.652916    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:34:42.665588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:42.665544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" event={"ID":"d1343d4f-1213-4e9b-a4fd-5b477695c7ed","Type":"ContainerStarted","Data":"27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b"}
Sep 11 18:34:42.732846 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:42.732812    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:42.733978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:42.733947    2561 patch_prober.go:28] interesting pod/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 11 18:34:42.734104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:42.734009    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 11 18:34:43.732222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:43.732185    2561 patch_prober.go:28] interesting pod/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 11 18:34:43.732617 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:43.732265    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 11 18:34:44.732346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:44.732281    2561 patch_prober.go:28] interesting pod/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 11 18:34:44.732729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:44.732370    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 11 18:34:45.733007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:45.732962    2561 patch_prober.go:28] interesting pod/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 11 18:34:45.733514 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:45.733036    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 11 18:34:46.252496 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:46.252448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:46.478006 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:46.477974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:46.732241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:46.732152    2561 patch_prober.go:28] interesting pod/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 11 18:34:46.732241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:46.732221    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 11 18:34:47.113242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:47.113209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:47.732457 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:47.732415    2561 patch_prober.go:28] interesting pod/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 11 18:34:47.732646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:47.732475    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 11 18:34:47.834853 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:47.834818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:48.582098 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:48.582063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:48.736536 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:48.736507    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:48.737657 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:48.737635    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:34:49.357047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.357011    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"]
Sep 11 18:34:49.364220 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.361817    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2681fcbe-a21c-40fd-964d-6e4a99742edf" containerName="istio-proxy"
Sep 11 18:34:49.367979 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.365628    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.370178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.370151    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-54fc63\"/\"openshift-service-ca.crt\""
Sep 11 18:34:49.370380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.370151    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-54fc63\"/\"default-dockercfg-nqhc5\""
Sep 11 18:34:49.370608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.370152    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-54fc63\"/\"explicit-model-54fc63-kserve-self-signed-certs\""
Sep 11 18:34:49.370753 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.370329    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-54fc63\"/\"kube-root-ca.crt\""
Sep 11 18:34:49.374087 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.374055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"]
Sep 11 18:34:49.375521 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.375498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:49.468845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.468807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-model-cache\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.468845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.468847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mclx5\" (UniqueName: \"kubernetes.io/projected/3166ba10-6c77-4c90-8441-8565b13e1e12-kube-api-access-mclx5\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.469088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.468883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3166ba10-6c77-4c90-8441-8565b13e1e12-tls-certs\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.469088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.468955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-dshm\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.469088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.469029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-tmp-dir\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.469088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.469063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-home\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.480701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.480668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:49.570134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3166ba10-6c77-4c90-8441-8565b13e1e12-tls-certs\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-dshm\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-tmp-dir\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-home\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-model-cache\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mclx5\" (UniqueName: \"kubernetes.io/projected/3166ba10-6c77-4c90-8441-8565b13e1e12-kube-api-access-mclx5\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-tmp-dir\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-home\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.570858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.570838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-model-cache\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.572561 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.572537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-dshm\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.572817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.572800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3166ba10-6c77-4c90-8441-8565b13e1e12-tls-certs\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.579595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.579571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mclx5\" (UniqueName: \"kubernetes.io/projected/3166ba10-6c77-4c90-8441-8565b13e1e12-kube-api-access-mclx5\") pod \"explicit-model-54fc63-kserve-64b9d99cff-rm6kj\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") " pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.679905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.679819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:49.871674 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.871639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:49.957982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:49.957950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"]
Sep 11 18:34:49.959575 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:34:49.959547    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3166ba10_6c77_4c90_8441_8565b13e1e12.slice/crio-a99b3279e15a2c8f198100e68dff50667ced8408f74eb37840b976e49a4e8c0d WatchSource:0}: Error finding container a99b3279e15a2c8f198100e68dff50667ced8408f74eb37840b976e49a4e8c0d: Status 404 returned error can't find the container with id a99b3279e15a2c8f198100e68dff50667ced8408f74eb37840b976e49a4e8c0d
Sep 11 18:34:50.228681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.228585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:50.514233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.514197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:50.616372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.616343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:50.723834 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.723795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj" event={"ID":"3166ba10-6c77-4c90-8441-8565b13e1e12","Type":"ContainerStarted","Data":"ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a"}
Sep 11 18:34:50.724214 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.723845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj" event={"ID":"3166ba10-6c77-4c90-8441-8565b13e1e12","Type":"ContainerStarted","Data":"a99b3279e15a2c8f198100e68dff50667ced8408f74eb37840b976e49a4e8c0d"}
Sep 11 18:34:50.745547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.745488    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj" podStartSLOduration=1.745465522 podStartE2EDuration="1.745465522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:34:50.742757707 +0000 UTC m=+1133.317861178" watchObservedRunningTime="2026-09-11 18:34:50.745465522 +0000 UTC m=+1133.320568993"
Sep 11 18:34:50.992531 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:50.992438    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:51.142822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:51.142790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:54.845097 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.845060    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"]
Sep 11 18:34:54.848976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.848958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.852701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.852629    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0d18cc\"/\"kube-root-ca.crt\""
Sep 11 18:34:54.852835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.852725    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0d18cc\"/\"default-dockercfg-qkvgq\""
Sep 11 18:34:54.852835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.852786    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0d18cc\"/\"openshift-service-ca.crt\""
Sep 11 18:34:54.852976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.852860    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0d18cc\"/\"test-model-0d18cc-kserve-self-signed-certs\""
Sep 11 18:34:54.859468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.858956    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"]
Sep 11 18:34:54.927199 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.927161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tls-certs\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.927388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.927228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-dshm\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.927463 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.927436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-model-cache\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.927526 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.927508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-home\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.927579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.927554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tmp-dir\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.927632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.927590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9crzj\" (UniqueName: \"kubernetes.io/projected/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-kube-api-access-9crzj\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:54.948980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:54.948945    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:55.028174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-model-cache\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-home\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tmp-dir\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9crzj\" (UniqueName: \"kubernetes.io/projected/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-kube-api-access-9crzj\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tls-certs\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028495 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-dshm\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-model-cache\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tmp-dir\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.028831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.028813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-home\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.030797 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.030774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-dshm\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.031177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.031157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tls-certs\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.038346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.038320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9crzj\" (UniqueName: \"kubernetes.io/projected/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-kube-api-access-9crzj\") pod \"test-model-0d18cc-kserve-777787785f-hw49h\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") " pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.161694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.161599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:34:55.446123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.446096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"]
Sep 11 18:34:55.448455 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:34:55.448426    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fd7bdbc_c342_4f69_8334_05cb35c69c8e.slice/crio-0d2bc1ae0317b2ee162eacec6ed73bbf61ecde384640a625a1f586139b9b7210 WatchSource:0}: Error finding container 0d2bc1ae0317b2ee162eacec6ed73bbf61ecde384640a625a1f586139b9b7210: Status 404 returned error can't find the container with id 0d2bc1ae0317b2ee162eacec6ed73bbf61ecde384640a625a1f586139b9b7210
Sep 11 18:34:55.758942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.758906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h" event={"ID":"3fd7bdbc-c342-4f69-8334-05cb35c69c8e","Type":"ContainerStarted","Data":"c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189"}
Sep 11 18:34:55.759122 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.758956    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h" event={"ID":"3fd7bdbc-c342-4f69-8334-05cb35c69c8e","Type":"ContainerStarted","Data":"0d2bc1ae0317b2ee162eacec6ed73bbf61ecde384640a625a1f586139b9b7210"}
Sep 11 18:34:55.783812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:55.783760    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h" podStartSLOduration=1.7837426779999999 podStartE2EDuration="1.783742678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:34:55.779533736 +0000 UTC m=+1138.354637203" watchObservedRunningTime="2026-09-11 18:34:55.783742678 +0000 UTC m=+1138.358846145"
Sep 11 18:34:56.779585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:56.779549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:56.848422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:56.848392    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:57.144134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.144033    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"]
Sep 11 18:34:57.147875 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.147846    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:34:57.150652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.150620    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:34:57.157926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.157894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"]
Sep 11 18:34:57.254417 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.254375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84db301e-2c23-45bb-b137-931c92a78d89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd\" (UID: \"84db301e-2c23-45bb-b137-931c92a78d89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:34:57.355197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.355156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84db301e-2c23-45bb-b137-931c92a78d89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd\" (UID: \"84db301e-2c23-45bb-b137-931c92a78d89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:34:57.355898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.355874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84db301e-2c23-45bb-b137-931c92a78d89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd\" (UID: \"84db301e-2c23-45bb-b137-931c92a78d89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:34:57.462963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.462872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:34:57.742723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.742693    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"]
Sep 11 18:34:57.743808 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:34:57.743785    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84db301e_2c23_45bb_b137_931c92a78d89.slice/crio-f5d51566a6221b50b7d628aff58f2aa4a836a0a5372e6a7190e7388af9e1da29 WatchSource:0}: Error finding container f5d51566a6221b50b7d628aff58f2aa4a836a0a5372e6a7190e7388af9e1da29: Status 404 returned error can't find the container with id f5d51566a6221b50b7d628aff58f2aa4a836a0a5372e6a7190e7388af9e1da29
Sep 11 18:34:57.774206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.774179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd" event={"ID":"84db301e-2c23-45bb-b137-931c92a78d89","Type":"ContainerStarted","Data":"f5d51566a6221b50b7d628aff58f2aa4a836a0a5372e6a7190e7388af9e1da29"}
Sep 11 18:34:57.939814 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:57.939775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:58.782975 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:58.782932    2561 generic.go:356] "Generic (PLEG): container finished" podID="84db301e-2c23-45bb-b137-931c92a78d89" containerID="7aef516f4528db8ff24bdc90cbf1ef8aa299dede3c2a005826764cba63a54a3e" exitCode=0
Sep 11 18:34:58.783150 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:58.783015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd" event={"ID":"84db301e-2c23-45bb-b137-931c92a78d89","Type":"ContainerDied","Data":"7aef516f4528db8ff24bdc90cbf1ef8aa299dede3c2a005826764cba63a54a3e"}
Sep 11 18:34:58.903479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:58.903440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:59.607084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.607043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:34:59.680001 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.679961    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:59.680317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.680270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:59.693254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.693222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:59.801947 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.801919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:34:59.948926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.948900    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:34:59.982820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.982781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84db301e-2c23-45bb-b137-931c92a78d89-maas-api-service-ca\") pod \"84db301e-2c23-45bb-b137-931c92a78d89\" (UID: \"84db301e-2c23-45bb-b137-931c92a78d89\") "
Sep 11 18:34:59.983207 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.983183    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84db301e-2c23-45bb-b137-931c92a78d89-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84db301e-2c23-45bb-b137-931c92a78d89" (UID: "84db301e-2c23-45bb-b137-931c92a78d89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:34:59.983353 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:34:59.983338    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84db301e-2c23-45bb-b137-931c92a78d89-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:00.526432 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:00.526399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:00.797744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:00.797661    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"
Sep 11 18:35:00.797744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:00.797698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd" event={"ID":"84db301e-2c23-45bb-b137-931c92a78d89","Type":"ContainerDied","Data":"f5d51566a6221b50b7d628aff58f2aa4a836a0a5372e6a7190e7388af9e1da29"}
Sep 11 18:35:00.797744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:00.797742    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5d51566a6221b50b7d628aff58f2aa4a836a0a5372e6a7190e7388af9e1da29"
Sep 11 18:35:01.214013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:01.213922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:01.932317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:01.932281    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:02.681421 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:02.681384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:05.161856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:05.161818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:35:05.162350 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:05.161896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:35:05.174935 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:05.174908    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:35:05.843975 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:05.843945    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:35:07.839347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:07.839315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:07.919590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:07.919558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:07.988543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:07.988515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:08.063130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:08.063089    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"]
Sep 11 18:35:08.065704 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:08.065670    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-489fe7a4-csqqd"]
Sep 11 18:35:08.092033 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:08.091942    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:08.171492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:08.171454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:08.533983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:08.533941    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:09.278447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:09.278413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:09.909246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:09.909204    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84db301e-2c23-45bb-b137-931c92a78d89" path="/var/lib/kubelet/pods/84db301e-2c23-45bb-b137-931c92a78d89/volumes"
Sep 11 18:35:09.967841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:09.967806    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:10.751582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:10.751548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:11.429109 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:11.429076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:12.150709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:12.150676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:13.466433 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:13.466395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:16.956965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:16.956923    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"]
Sep 11 18:35:16.969049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:16.969019    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:17.408029 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:17.407998    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:19.293819 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.293774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:19.369135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.369103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:19.529863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.529829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:19.549588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.549502    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"]
Sep 11 18:35:19.549771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.549743    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy" containerID="cri-o://27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b" gracePeriod=30
Sep 11 18:35:19.624570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.624533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:19.889658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.889502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:19.979174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:19.979130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:20.097357 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:20.097233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:20.328599 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:20.328559    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:21.087046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:21.087015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:22.041422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:22.041383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:22.776069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:22.776028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:23.625283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:23.625244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:24.822769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.822701    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:35:24.955585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955552    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-podinfo\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.955770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-socket\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.955770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955681    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-envoy\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.955770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955704    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-token\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.955770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955742    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-certs\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.955981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955808    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-credential-socket\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.955981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955856    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istiod-ca-cert\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.956099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.955955    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:24.956099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.956062    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:24.956216 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.956140    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:24.956360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.956331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7xk5\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-kube-api-access-t7xk5\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.956568 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.956411    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:35:24.956661 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.956557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-data\") pod \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\" (UID: \"d1343d4f-1213-4e9b-a4fd-5b477695c7ed\") "
Sep 11 18:35:24.956963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.956932    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:24.957198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.957176    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:24.957291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.957203    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:24.957291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.957217    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:24.957291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.957231    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:24.957291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.957244    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:24.958682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.958657    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:35:24.958772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.958682    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:24.958772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.958711    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:24.958772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.958765    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-kube-api-access-t7xk5" (OuterVolumeSpecName: "kube-api-access-t7xk5") pod "d1343d4f-1213-4e9b-a4fd-5b477695c7ed" (UID: "d1343d4f-1213-4e9b-a4fd-5b477695c7ed"). InnerVolumeSpecName "kube-api-access-t7xk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:24.964677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.964653    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerID="27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b" exitCode=0
Sep 11 18:35:24.964771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.964708    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"
Sep 11 18:35:24.964771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.964733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" event={"ID":"d1343d4f-1213-4e9b-a4fd-5b477695c7ed","Type":"ContainerDied","Data":"27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b"}
Sep 11 18:35:24.964906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.964794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q" event={"ID":"d1343d4f-1213-4e9b-a4fd-5b477695c7ed","Type":"ContainerDied","Data":"1a57d1c2b2f8f93e8a93edc6a3ffbdb6296194259fd078ca16d9a05b1fcfb3dc"}
Sep 11 18:35:24.964906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.964818    2561 scope.go:117] "RemoveContainer" containerID="27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b"
Sep 11 18:35:24.983266 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.983248    2561 scope.go:117] "RemoveContainer" containerID="eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"
Sep 11 18:35:24.992975 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.992954    2561 scope.go:117] "RemoveContainer" containerID="27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b"
Sep 11 18:35:24.993294 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:35:24.993274    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b\": container with ID starting with 27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b not found: ID does not exist" containerID="27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b"
Sep 11 18:35:24.993388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.993328    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b"} err="failed to get container status \"27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b\": rpc error: code = NotFound desc = could not find container \"27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b\": container with ID starting with 27dd913ff2d9ec6520220227dcc1bb31bdd9d07760513c6a1760d60de75e661b not found: ID does not exist"
Sep 11 18:35:24.993388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.993350    2561 scope.go:117] "RemoveContainer" containerID="eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"
Sep 11 18:35:24.993624 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:35:24.993607    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384\": container with ID starting with eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384 not found: ID does not exist" containerID="eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"
Sep 11 18:35:24.993670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.993628    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384"} err="failed to get container status \"eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384\": rpc error: code = NotFound desc = could not find container \"eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384\": container with ID starting with eab7f2e6a5b31df0a95b84d04e7ac3199b87ff0ab1454581079f03a66cb3b384 not found: ID does not exist"
Sep 11 18:35:24.996103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.995928    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"]
Sep 11 18:35:24.999231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:24.999211    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q"]
Sep 11 18:35:25.058356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:25.058286    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:25.058356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:25.058352    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:25.058356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:25.058362    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7xk5\" (UniqueName: \"kubernetes.io/projected/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-kube-api-access-t7xk5\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:25.058570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:25.058372    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1343d4f-1213-4e9b-a4fd-5b477695c7ed-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:25.909075 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:25.909039    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" path="/var/lib/kubelet/pods/d1343d4f-1213-4e9b-a4fd-5b477695c7ed/volumes"
Sep 11 18:35:26.243508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:26.243405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:26.350070 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:26.350031    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:26.444570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:26.444536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:26.566591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:26.566554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:27.710587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:27.710538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:27.812057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:27.812011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:27.916030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:27.915980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:27.983228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:27.983132    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:28.326278 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:28.326243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:28.427111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:28.427067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:29.344810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:29.344763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:30.133213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:30.133167    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:30.950779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:30.950739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:31.747540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:31.747497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:31.977851 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:31.977803    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj" podUID="3166ba10-6c77-4c90-8441-8565b13e1e12" containerName="main" containerID="cri-o://ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a" gracePeriod=45
Sep 11 18:35:32.234660 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.234632    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:35:32.341710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.341622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-dshm\") pod \"3166ba10-6c77-4c90-8441-8565b13e1e12\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") "
Sep 11 18:35:32.341710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.341664    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3166ba10-6c77-4c90-8441-8565b13e1e12-tls-certs\") pod \"3166ba10-6c77-4c90-8441-8565b13e1e12\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") "
Sep 11 18:35:32.341710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.341701    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mclx5\" (UniqueName: \"kubernetes.io/projected/3166ba10-6c77-4c90-8441-8565b13e1e12-kube-api-access-mclx5\") pod \"3166ba10-6c77-4c90-8441-8565b13e1e12\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") "
Sep 11 18:35:32.341966 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.341739    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-home\") pod \"3166ba10-6c77-4c90-8441-8565b13e1e12\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") "
Sep 11 18:35:32.341966 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.341846    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-model-cache\") pod \"3166ba10-6c77-4c90-8441-8565b13e1e12\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") "
Sep 11 18:35:32.341966 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.341873    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-tmp-dir\") pod \"3166ba10-6c77-4c90-8441-8565b13e1e12\" (UID: \"3166ba10-6c77-4c90-8441-8565b13e1e12\") "
Sep 11 18:35:32.342123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.342088    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-home" (OuterVolumeSpecName: "home") pod "3166ba10-6c77-4c90-8441-8565b13e1e12" (UID: "3166ba10-6c77-4c90-8441-8565b13e1e12"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:32.342123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.342103    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-model-cache" (OuterVolumeSpecName: "model-cache") pod "3166ba10-6c77-4c90-8441-8565b13e1e12" (UID: "3166ba10-6c77-4c90-8441-8565b13e1e12"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:32.342240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.342188    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3166ba10-6c77-4c90-8441-8565b13e1e12" (UID: "3166ba10-6c77-4c90-8441-8565b13e1e12"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:32.342392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.342367    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:32.342392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.342393    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:32.342544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.342408    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:32.343981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.343958    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-dshm" (OuterVolumeSpecName: "dshm") pod "3166ba10-6c77-4c90-8441-8565b13e1e12" (UID: "3166ba10-6c77-4c90-8441-8565b13e1e12"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:32.344079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.343984    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3166ba10-6c77-4c90-8441-8565b13e1e12-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3166ba10-6c77-4c90-8441-8565b13e1e12" (UID: "3166ba10-6c77-4c90-8441-8565b13e1e12"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:35:32.344079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.344001    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3166ba10-6c77-4c90-8441-8565b13e1e12-kube-api-access-mclx5" (OuterVolumeSpecName: "kube-api-access-mclx5") pod "3166ba10-6c77-4c90-8441-8565b13e1e12" (UID: "3166ba10-6c77-4c90-8441-8565b13e1e12"). InnerVolumeSpecName "kube-api-access-mclx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:32.443447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.443412    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3166ba10-6c77-4c90-8441-8565b13e1e12-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:32.443447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.443441    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3166ba10-6c77-4c90-8441-8565b13e1e12-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:32.443447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.443454    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mclx5\" (UniqueName: \"kubernetes.io/projected/3166ba10-6c77-4c90-8441-8565b13e1e12-kube-api-access-mclx5\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:32.558556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:32.558518    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:33.000454 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.000418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:33.019905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.019865    2561 generic.go:356] "Generic (PLEG): container finished" podID="3166ba10-6c77-4c90-8441-8565b13e1e12" containerID="ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a" exitCode=0
Sep 11 18:35:33.020095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.019912    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"
Sep 11 18:35:33.020095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.019949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj" event={"ID":"3166ba10-6c77-4c90-8441-8565b13e1e12","Type":"ContainerDied","Data":"ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a"}
Sep 11 18:35:33.020095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.020012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj" event={"ID":"3166ba10-6c77-4c90-8441-8565b13e1e12","Type":"ContainerDied","Data":"a99b3279e15a2c8f198100e68dff50667ced8408f74eb37840b976e49a4e8c0d"}
Sep 11 18:35:33.020095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.020036    2561 scope.go:117] "RemoveContainer" containerID="ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a"
Sep 11 18:35:33.031117 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.031091    2561 scope.go:117] "RemoveContainer" containerID="ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a"
Sep 11 18:35:33.031450 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:35:33.031430    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a\": container with ID starting with ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a not found: ID does not exist" containerID="ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a"
Sep 11 18:35:33.031522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.031459    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a"} err="failed to get container status \"ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a\": rpc error: code = NotFound desc = could not find container \"ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a\": container with ID starting with ed7f5baae7aac46efcb71599b9757be7265fb9855af023c52387000d3cfdc80a not found: ID does not exist"
Sep 11 18:35:33.049062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.049019    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"]
Sep 11 18:35:33.052921 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.052892    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-54fc63/explicit-model-54fc63-kserve-64b9d99cff-rm6kj"]
Sep 11 18:35:33.107901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.107859    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:33.915705 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.915665    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3166ba10-6c77-4c90-8441-8565b13e1e12" path="/var/lib/kubelet/pods/3166ba10-6c77-4c90-8441-8565b13e1e12/volumes"
Sep 11 18:35:33.991971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:33.991931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:34.303948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.303916    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"]
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy"
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304412    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy"
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304428    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy"
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304434    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy"
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304441    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3166ba10-6c77-4c90-8441-8565b13e1e12" containerName="main"
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304447    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3166ba10-6c77-4c90-8441-8565b13e1e12" containerName="main"
Sep 11 18:35:34.304453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304459    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84db301e-2c23-45bb-b137-931c92a78d89" containerName="revoke-keys"
Sep 11 18:35:34.304847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304465    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="84db301e-2c23-45bb-b137-931c92a78d89" containerName="revoke-keys"
Sep 11 18:35:34.304847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304531    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3166ba10-6c77-4c90-8441-8565b13e1e12" containerName="main"
Sep 11 18:35:34.304847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304539    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="84db301e-2c23-45bb-b137-931c92a78d89" containerName="revoke-keys"
Sep 11 18:35:34.304847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304551    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy"
Sep 11 18:35:34.304847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.304557    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1343d4f-1213-4e9b-a4fd-5b477695c7ed" containerName="istio-proxy"
Sep 11 18:35:34.309255 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.309223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.313252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.313229    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-93d67f-openshift-default-dockercfg-npznh\""
Sep 11 18:35:34.320733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.320698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"]
Sep 11 18:35:34.344545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.344515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:34.360252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-credential-socket\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-envoy\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnkck\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-kube-api-access-mnkck\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-token\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-certs\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360486    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-socket\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-data\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-podinfo\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.360629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.360610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b41ab01f-6184-4ebc-aa5f-56713e349e45-istiod-ca-cert\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.455747 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.455709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:34.461992 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.461963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-credential-socket\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.461992 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.461994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-envoy\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnkck\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-kube-api-access-mnkck\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-token\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-certs\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-socket\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-data\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-podinfo\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b41ab01f-6184-4ebc-aa5f-56713e349e45-istiod-ca-cert\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-socket\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-data\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462756 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-certs\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.462814 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.462742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-credential-socket\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.463032 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.463015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b41ab01f-6184-4ebc-aa5f-56713e349e45-istiod-ca-cert\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.464424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.464404    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-envoy\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.464831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.464810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-podinfo\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.472867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.472843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-token\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.473174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.473156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnkck\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-kube-api-access-mnkck\") pod \"e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") " pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.623763 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.623666    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:34.909845 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:35:34.909805    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41ab01f_6184_4ebc_aa5f_56713e349e45.slice/crio-e00ebb263fb5a733e1165f2d08768f35c28a8a915dda692edb96540f47f5dd3b WatchSource:0}: Error finding container e00ebb263fb5a733e1165f2d08768f35c28a8a915dda692edb96540f47f5dd3b: Status 404 returned error can't find the container with id e00ebb263fb5a733e1165f2d08768f35c28a8a915dda692edb96540f47f5dd3b
Sep 11 18:35:34.912196 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.912159    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:35:34.912266 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.912230    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:35:34.912321 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.912267    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:35:34.914063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.914037    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"]
Sep 11 18:35:34.935978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:34.935950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:35.034179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.034145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:35.039643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.039608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" event={"ID":"b41ab01f-6184-4ebc-aa5f-56713e349e45","Type":"ContainerStarted","Data":"e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"}
Sep 11 18:35:35.039813 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.039669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" event={"ID":"b41ab01f-6184-4ebc-aa5f-56713e349e45","Type":"ContainerStarted","Data":"e00ebb263fb5a733e1165f2d08768f35c28a8a915dda692edb96540f47f5dd3b"}
Sep 11 18:35:35.112155 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.112097    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podStartSLOduration=1.112078736 podStartE2EDuration="1.112078736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:35:35.107764244 +0000 UTC m=+1177.682867711" watchObservedRunningTime="2026-09-11 18:35:35.112078736 +0000 UTC m=+1177.687182203"
Sep 11 18:35:35.191768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.191684    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"]
Sep 11 18:35:35.191955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.191931    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy" containerID="cri-o://c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1" gracePeriod=30
Sep 11 18:35:35.251213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.251177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:35.608722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.608671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:35.624473 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.624439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:35.629785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.629758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:35.963940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.963858    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"]
Sep 11 18:35:35.967865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.967832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:35.972235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.972213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-aab3a7-openshift-default-dockercfg-tg9f8\""
Sep 11 18:35:35.979850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:35.979820    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"]
Sep 11 18:35:36.007683 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.007648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:36.045890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.045859    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:36.046866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.046843    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:35:36.080317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-envoy\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-data\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6wwq\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-kube-api-access-c6wwq\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fec78865-d3f4-4468-9c1d-b5e7a4442883-istiod-ca-cert\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-token\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-socket\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-credential-socket\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-podinfo\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.080942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.080724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-certs\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.181954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.181919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-envoy\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.181954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.181957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-data\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.181982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6wwq\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-kube-api-access-c6wwq\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fec78865-d3f4-4468-9c1d-b5e7a4442883-istiod-ca-cert\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-token\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182124    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-socket\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-credential-socket\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-podinfo\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-certs\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182593 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-data\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182655 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-socket\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182655 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182640    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-credential-socket\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fec78865-d3f4-4468-9c1d-b5e7a4442883-istiod-ca-cert\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.182945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.182871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-certs\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.184524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.184503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-envoy\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.184992 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.184971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-podinfo\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.191169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.191144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6wwq\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-kube-api-access-c6wwq\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.191284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.191250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-token\") pod \"e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") " pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.282595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.282553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:36.443369 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.443328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:36.570430 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:35:36.570380    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec78865_d3f4_4468_9c1d_b5e7a4442883.slice/crio-38edeac7035c102267c8f9cae2dcc5f361a726843a0e1739806eaae53b55cc7f WatchSource:0}: Error finding container 38edeac7035c102267c8f9cae2dcc5f361a726843a0e1739806eaae53b55cc7f: Status 404 returned error can't find the container with id 38edeac7035c102267c8f9cae2dcc5f361a726843a0e1739806eaae53b55cc7f
Sep 11 18:35:36.573493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.573449    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:35:36.573601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.573536    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:35:36.573601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.573577    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:35:36.575616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.575591    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"]
Sep 11 18:35:36.661907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:36.661860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:37.062772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.062736    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c" event={"ID":"fec78865-d3f4-4468-9c1d-b5e7a4442883","Type":"ContainerStarted","Data":"f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e"}
Sep 11 18:35:37.062991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.062819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c" event={"ID":"fec78865-d3f4-4468-9c1d-b5e7a4442883","Type":"ContainerStarted","Data":"38edeac7035c102267c8f9cae2dcc5f361a726843a0e1739806eaae53b55cc7f"}
Sep 11 18:35:37.084629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.084575    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c" podStartSLOduration=2.084559615 podStartE2EDuration="2.084559615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:35:37.082839889 +0000 UTC m=+1179.657943358" watchObservedRunningTime="2026-09-11 18:35:37.084559615 +0000 UTC m=+1179.659663082"
Sep 11 18:35:37.159897 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.159855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:37.278870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.278821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:37.283731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.283710    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:37.289481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.289458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:37.502901 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.502868    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:37.601673 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.601640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:37.720255 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.720216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:37.820242 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:37.820143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:38.069685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:38.069649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:38.070632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:38.070562    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:35:38.848621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:38.848586    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:39.694895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:39.694858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:40.454587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.454529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:35:40.462670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.462644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:40.533362 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-envoy\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533362 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533362    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-socket\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533397    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-credential-socket\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533419    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-token\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533447    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-certs\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533490    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-data\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533514    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istiod-ca-cert\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx64m\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-kube-api-access-kx64m\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.533677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-podinfo\") pod \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\" (UID: \"6cf04adb-0f88-48e2-a2f0-93ab432b34e9\") "
Sep 11 18:35:40.534007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533780    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:40.534007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533774    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:40.534007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533797    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:40.534007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.533812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:40.534217 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.534135    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:35:40.534217 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.534195    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.534343 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.534217    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.534343 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.534230    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.534343 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.534239    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.535744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.535718    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:40.535744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.535732    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:35:40.535960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.535940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:35:40.536064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.536046    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-kube-api-access-kx64m" (OuterVolumeSpecName: "kube-api-access-kx64m") pod "6cf04adb-0f88-48e2-a2f0-93ab432b34e9" (UID: "6cf04adb-0f88-48e2-a2f0-93ab432b34e9"). InnerVolumeSpecName "kube-api-access-kx64m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:35:40.635405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.635372    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.635405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.635398    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.635405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.635407    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.635635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.635416    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx64m\" (UniqueName: \"kubernetes.io/projected/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-kube-api-access-kx64m\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.635635 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.635426    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf04adb-0f88-48e2-a2f0-93ab432b34e9-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:35:40.978768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:40.978723    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:41.091980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.091947    2561 generic.go:356] "Generic (PLEG): container finished" podID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerID="c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1" exitCode=0
Sep 11 18:35:41.092183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.092016    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"
Sep 11 18:35:41.092183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.092051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" event={"ID":"6cf04adb-0f88-48e2-a2f0-93ab432b34e9","Type":"ContainerDied","Data":"c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1"}
Sep 11 18:35:41.092183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.092121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv" event={"ID":"6cf04adb-0f88-48e2-a2f0-93ab432b34e9","Type":"ContainerDied","Data":"93874289f209dbb4d7edf59e0087f3ed6a9b0416db37c2b7e1acf317e1b29350"}
Sep 11 18:35:41.092183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.092146    2561 scope.go:117] "RemoveContainer" containerID="c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1"
Sep 11 18:35:41.106207 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.106184    2561 scope.go:117] "RemoveContainer" containerID="20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"
Sep 11 18:35:41.115891 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.115866    2561 scope.go:117] "RemoveContainer" containerID="c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1"
Sep 11 18:35:41.116190 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:35:41.116168    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1\": container with ID starting with c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1 not found: ID does not exist" containerID="c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1"
Sep 11 18:35:41.116254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.116200    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1"} err="failed to get container status \"c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1\": rpc error: code = NotFound desc = could not find container \"c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1\": container with ID starting with c130e27c3f557cdc2475b4dac28837800b1db11a9ca8acff7ffa15a558b14df1 not found: ID does not exist"
Sep 11 18:35:41.116254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.116220    2561 scope.go:117] "RemoveContainer" containerID="20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"
Sep 11 18:35:41.116502 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:35:41.116486    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff\": container with ID starting with 20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff not found: ID does not exist" containerID="20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"
Sep 11 18:35:41.116551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.116507    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff"} err="failed to get container status \"20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff\": rpc error: code = NotFound desc = could not find container \"20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff\": container with ID starting with 20dd4e3123b7de77c87dac1a0c981ce7357f9d7fbbbffb6be347018658290cff not found: ID does not exist"
Sep 11 18:35:41.125341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.125293    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"]
Sep 11 18:35:41.128601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.128575    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv"]
Sep 11 18:35:41.303479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.303433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:41.364574 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.364538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:41.759464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.759422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:41.856247 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.856214    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:41.910557 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.910519    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" path="/var/lib/kubelet/pods/6cf04adb-0f88-48e2-a2f0-93ab432b34e9/volumes"
Sep 11 18:35:41.961334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:41.945415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:35:57.938586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:57.938552    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:35:57.940466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:57.940444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:35:59.051441 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:35:59.051382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:02.175982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:02.175928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:03.714334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:03.714284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:04.611114 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:04.611074    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:05.330889 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:05.330840    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:06.023790 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:06.023754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:06.764906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:06.764857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:07.087554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.087470    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:36:07.087554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.087531    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:36:07.246620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.246585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:07.513377 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.513344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:07.610487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.610450    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:07.964196 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.964162    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"]
Sep 11 18:36:07.964872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.964849    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy"
Sep 11 18:36:07.964969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.964882    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy"
Sep 11 18:36:07.965068 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.965054    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy"
Sep 11 18:36:07.967271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.967247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:07.970900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.970881    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-e6454f-openshift-default-dockercfg-5rkj2\""
Sep 11 18:36:07.984739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.984710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"]
Sep 11 18:36:07.992269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:07.992236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:08.034367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-envoy\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-socket\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-podinfo\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-token\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8gzb\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-kube-api-access-w8gzb\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-certs\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034766 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-credential-socket\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.034766 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.034748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-data\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-podinfo\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-token\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8gzb\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-kube-api-access-w8gzb\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-certs\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-credential-socket\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-data\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-envoy\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-socket\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-certs\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-credential-socket\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.136898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-data\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.137054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136966    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-socket\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.137054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.136984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.138777 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.138756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-envoy\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.139018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.138998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-podinfo\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.143983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.143955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8gzb\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-kube-api-access-w8gzb\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.144100 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.144039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-token\") pod \"e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.288428 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.288395    2561 generic.go:356] "Generic (PLEG): container finished" podID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerID="e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385" exitCode=0
Sep 11 18:36:08.288615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.288459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" event={"ID":"b41ab01f-6184-4ebc-aa5f-56713e349e45","Type":"ContainerDied","Data":"e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"}
Sep 11 18:36:08.288915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.288899    2561 scope.go:117] "RemoveContainer" containerID="e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"
Sep 11 18:36:08.290137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.290106    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:08.290207 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.290194    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:08.290244 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.290227    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:08.305104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.305082    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:08.366486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.365930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:08.598735 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.598705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"]
Sep 11 18:36:08.601003 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:36:08.600974    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5e2657_c836_4a70_b4d2_d9dc2132a9e0.slice/crio-d5cd7a380f2850071140258749d97c08db317cd6faab1de69cd5165210980a01 WatchSource:0}: Error finding container d5cd7a380f2850071140258749d97c08db317cd6faab1de69cd5165210980a01: Status 404 returned error can't find the container with id d5cd7a380f2850071140258749d97c08db317cd6faab1de69cd5165210980a01
Sep 11 18:36:08.603620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.603585    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:08.603718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.603652    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:08.603718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:08.603683    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:09.296943 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.296900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" event={"ID":"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0","Type":"ContainerStarted","Data":"b62822a853de70dd89669b90ffe0f2a612b707c4662b6c85a6162eee46753001"}
Sep 11 18:36:09.297582 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.296993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" event={"ID":"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0","Type":"ContainerStarted","Data":"d5cd7a380f2850071140258749d97c08db317cd6faab1de69cd5165210980a01"}
Sep 11 18:36:09.299779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.299718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" event={"ID":"b41ab01f-6184-4ebc-aa5f-56713e349e45","Type":"ContainerStarted","Data":"b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda"}
Sep 11 18:36:09.305939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.305916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:09.311291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.311266    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:09.318894 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.318841    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podStartSLOduration=2.31882279 podStartE2EDuration="2.31882279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:09.317186229 +0000 UTC m=+1211.892289722" watchObservedRunningTime="2026-09-11 18:36:09.31882279 +0000 UTC m=+1211.893926260"
Sep 11 18:36:09.624912 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.624818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:36:09.625075 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.625053    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:36:09.625130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:09.625099    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:36:10.306773 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:10.306741    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:10.307820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:10.307798    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:10.570646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:10.570542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:10.624049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:10.624010    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:36:10.624223 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:10.624074    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:36:11.232476 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:11.232442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:11.323575 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:11.323536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:11.625074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:11.625035    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:36:11.625266 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:11.625101    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:36:11.660162 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:11.660122    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:12.592708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:12.592676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:12.624214 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:12.624178    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:36:12.624397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:12.624270    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:36:13.506241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:13.506202    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:13.624630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:13.624590    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 11 18:36:13.625092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:13.624657    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 11 18:36:14.364037 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:14.363987    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:14.627697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:14.627620    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:36:14.628066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:14.627897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:36:14.628704 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:14.628681    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:36:15.058426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:15.058394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:15.872832 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:15.872789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:15.970992 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:15.970958    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:16.385251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:16.385219    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:16.481159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:16.481126    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:16.655825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:16.655735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:30.855984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:30.855947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:38.673981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:38.673942    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:39.355779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:39.355731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:40.275969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:40.275935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:41.205050 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:41.205010    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:41.348491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:41.348452    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 18:36:41.348870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:41.348530    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 18:36:41.369010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:41.368970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:42.139982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.139938    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7536-5c83e6"]
Sep 11 18:36:42.140516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.140500    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy"
Sep 11 18:36:42.140598 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.140520    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy"
Sep 11 18:36:42.140639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.140619    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf04adb-0f88-48e2-a2f0-93ab432b34e9" containerName="istio-proxy"
Sep 11 18:36:42.142780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.142765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:42.145913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.145860    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t65h9\""
Sep 11 18:36:42.156970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.156945    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-5c83e6"]
Sep 11 18:36:42.226538 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.226502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdlx\" (UniqueName: \"kubernetes.io/projected/04227e11-425b-4561-859c-11269b66825c-kube-api-access-7bdlx\") pod \"test-curl-7536-5c83e6\" (UID: \"04227e11-425b-4561-859c-11269b66825c\") " pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:42.266878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.266836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:42.327733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.327698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdlx\" (UniqueName: \"kubernetes.io/projected/04227e11-425b-4561-859c-11269b66825c-kube-api-access-7bdlx\") pod \"test-curl-7536-5c83e6\" (UID: \"04227e11-425b-4561-859c-11269b66825c\") " pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:42.337487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.337456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdlx\" (UniqueName: \"kubernetes.io/projected/04227e11-425b-4561-859c-11269b66825c-kube-api-access-7bdlx\") pod \"test-curl-7536-5c83e6\" (UID: \"04227e11-425b-4561-859c-11269b66825c\") " pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:42.452008 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.451975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:42.534131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.534046    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerID="b62822a853de70dd89669b90ffe0f2a612b707c4662b6c85a6162eee46753001" exitCode=0
Sep 11 18:36:42.534131 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.534116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" event={"ID":"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0","Type":"ContainerDied","Data":"b62822a853de70dd89669b90ffe0f2a612b707c4662b6c85a6162eee46753001"}
Sep 11 18:36:42.534628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.534611    2561 scope.go:117] "RemoveContainer" containerID="b62822a853de70dd89669b90ffe0f2a612b707c4662b6c85a6162eee46753001"
Sep 11 18:36:42.536269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.535893    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:42.536269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.535966    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:42.536269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.535998    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:42.742991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.742790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-5c83e6"]
Sep 11 18:36:42.744400 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:36:42.744359    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04227e11_425b_4561_859c_11269b66825c.slice/crio-c0c70667d6815092b3c926a712c51bd032fcb68a95518b166eec0c14dd695814 WatchSource:0}: Error finding container c0c70667d6815092b3c926a712c51bd032fcb68a95518b166eec0c14dd695814: Status 404 returned error can't find the container with id c0c70667d6815092b3c926a712c51bd032fcb68a95518b166eec0c14dd695814
Sep 11 18:36:42.811668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:42.811631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:43.194346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:43.194226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:43.542923 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:43.542874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" event={"ID":"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0","Type":"ContainerStarted","Data":"c2a846c00031b2fc3def240c7a91978589694fc5ca62e0dc4eae35254a424e5e"}
Sep 11 18:36:43.546204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:43.546128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-5c83e6" event={"ID":"04227e11-425b-4561-859c-11269b66825c","Type":"ContainerStarted","Data":"f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27"}
Sep 11 18:36:43.546204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:43.546176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-5c83e6" event={"ID":"04227e11-425b-4561-859c-11269b66825c","Type":"ContainerStarted","Data":"c0c70667d6815092b3c926a712c51bd032fcb68a95518b166eec0c14dd695814"}
Sep 11 18:36:43.590135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:43.590069    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7536-5c83e6" podStartSLOduration=1.590053772 podStartE2EDuration="1.590053772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:43.588597667 +0000 UTC m=+1246.163701136" watchObservedRunningTime="2026-09-11 18:36:43.590053772 +0000 UTC m=+1246.165157239"
Sep 11 18:36:44.176345 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.176291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:44.302563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.302528    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7536-5c83e6"]
Sep 11 18:36:44.305645 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.305617    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:44.305917 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.305881    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 18:36:44.306015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.305943    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 18:36:44.307178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.307152    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7536-5c83e6"]
Sep 11 18:36:44.440855 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.440772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7536-2c91df"]
Sep 11 18:36:44.441272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.441258    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04227e11-425b-4561-859c-11269b66825c" containerName="test-curl-7536-5c83e6"
Sep 11 18:36:44.441331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.441275    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04227e11-425b-4561-859c-11269b66825c" containerName="test-curl-7536-5c83e6"
Sep 11 18:36:44.441396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.441386    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04227e11-425b-4561-859c-11269b66825c" containerName="test-curl-7536-5c83e6"
Sep 11 18:36:44.470329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.465553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:44.479652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.479616    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-2c91df"]
Sep 11 18:36:44.570250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.569746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm782\" (UniqueName: \"kubernetes.io/projected/5482ac40-2d11-475d-8419-b5c5f571ccf4-kube-api-access-qm782\") pod \"test-curl-7536-2c91df\" (UID: \"5482ac40-2d11-475d-8419-b5c5f571ccf4\") " pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:44.574074 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:44.574043    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7536-5c83e6" container="test-curl-7536-5c83e6"
Sep 11 18:36:44.670860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.670818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm782\" (UniqueName: \"kubernetes.io/projected/5482ac40-2d11-475d-8419-b5c5f571ccf4-kube-api-access-qm782\") pod \"test-curl-7536-2c91df\" (UID: \"5482ac40-2d11-475d-8419-b5c5f571ccf4\") " pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:44.678804 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.678778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm782\" (UniqueName: \"kubernetes.io/projected/5482ac40-2d11-475d-8419-b5c5f571ccf4-kube-api-access-qm782\") pod \"test-curl-7536-2c91df\" (UID: \"5482ac40-2d11-475d-8419-b5c5f571ccf4\") " pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:44.784135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:44.784101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:45.064579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.064485    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-2c91df"]
Sep 11 18:36:45.070137 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:36:45.070100    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5482ac40_2d11_475d_8419_b5c5f571ccf4.slice/crio-801dfc8f9f01dcbd798a0e22ca29be2383cadc47601ff5385796352c65918e40 WatchSource:0}: Error finding container 801dfc8f9f01dcbd798a0e22ca29be2383cadc47601ff5385796352c65918e40: Status 404 returned error can't find the container with id 801dfc8f9f01dcbd798a0e22ca29be2383cadc47601ff5385796352c65918e40
Sep 11 18:36:45.306064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.306022    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 18:36:45.306274 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.306092    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 18:36:45.582186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.582146    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-2c91df" event={"ID":"5482ac40-2d11-475d-8419-b5c5f571ccf4","Type":"ContainerStarted","Data":"5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749"}
Sep 11 18:36:45.582186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.582192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-2c91df" event={"ID":"5482ac40-2d11-475d-8419-b5c5f571ccf4","Type":"ContainerStarted","Data":"801dfc8f9f01dcbd798a0e22ca29be2383cadc47601ff5385796352c65918e40"}
Sep 11 18:36:45.582754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.582396    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7536-5c83e6" podUID="04227e11-425b-4561-859c-11269b66825c" containerName="test-curl-7536-5c83e6" containerID="cri-o://f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27" gracePeriod=2
Sep 11 18:36:45.599191 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:45.599154    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-5c83e6\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="04227e11-425b-4561-859c-11269b66825c" pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:45.601097 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:45.601045    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7536-2c91df" podStartSLOduration=1.60102762 podStartE2EDuration="1.60102762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:45.597161755 +0000 UTC m=+1248.172265224" watchObservedRunningTime="2026-09-11 18:36:45.60102762 +0000 UTC m=+1248.176131089"
Sep 11 18:36:46.255954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.255913    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7536-2c91df"]
Sep 11 18:36:46.262016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.261987    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7536-2c91df"]
Sep 11 18:36:46.305864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.305783    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 18:36:46.305864 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.305838    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 18:36:46.373134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.373090    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7536-6c08d7"]
Sep 11 18:36:46.373755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.373729    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" containerName="test-curl-7536-2c91df"
Sep 11 18:36:46.373755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.373755    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" containerName="test-curl-7536-2c91df"
Sep 11 18:36:46.373965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.373911    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" containerName="test-curl-7536-2c91df"
Sep 11 18:36:46.376205 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.376187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:46.380637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.380613    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-6c08d7"]
Sep 11 18:36:46.493770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.493734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v28n\" (UniqueName: \"kubernetes.io/projected/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5-kube-api-access-8v28n\") pod \"test-curl-7536-6c08d7\" (UID: \"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5\") " pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:46.590958 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:46.590865    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7536-2c91df" container="test-curl-7536-2c91df"
Sep 11 18:36:46.595180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.595155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v28n\" (UniqueName: \"kubernetes.io/projected/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5-kube-api-access-8v28n\") pod \"test-curl-7536-6c08d7\" (UID: \"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5\") " pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:46.604264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.604235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v28n\" (UniqueName: \"kubernetes.io/projected/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5-kube-api-access-8v28n\") pod \"test-curl-7536-6c08d7\" (UID: \"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5\") " pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:46.688444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.688411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:46.983825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:46.983784    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-6c08d7"]
Sep 11 18:36:46.985287 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:36:46.985257    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25f1bbd_e6a5_461c_b14e_43c5bc6613e5.slice/crio-bb1277da25cbff0d6845cfd9b7b2df14e54e0ef873ea2a74b7975a87a5c942c6 WatchSource:0}: Error finding container bb1277da25cbff0d6845cfd9b7b2df14e54e0ef873ea2a74b7975a87a5c942c6: Status 404 returned error can't find the container with id bb1277da25cbff0d6845cfd9b7b2df14e54e0ef873ea2a74b7975a87a5c942c6
Sep 11 18:36:47.305588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.305552    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 18:36:47.305769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.305611    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 18:36:47.599151 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.599122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-6c08d7" event={"ID":"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5","Type":"ContainerStarted","Data":"256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c"}
Sep 11 18:36:47.599528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.599171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-6c08d7" event={"ID":"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5","Type":"ContainerStarted","Data":"bb1277da25cbff0d6845cfd9b7b2df14e54e0ef873ea2a74b7975a87a5c942c6"}
Sep 11 18:36:47.599528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.599330    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7536-2c91df" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" containerName="test-curl-7536-2c91df" containerID="cri-o://5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749" gracePeriod=2
Sep 11 18:36:47.620379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.620336    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7536-6c08d7" podStartSLOduration=1.6203206350000001 podStartE2EDuration="1.620320635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:47.619455354 +0000 UTC m=+1250.194558823" watchObservedRunningTime="2026-09-11 18:36:47.620320635 +0000 UTC m=+1250.195424093"
Sep 11 18:36:47.621497 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:47.621467    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-2c91df\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:47.803377 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.803351    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:47.805612 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:47.805584    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-2c91df\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:47.908200 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:47.908120    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-2c91df\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:47.909038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.909021    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdlx\" (UniqueName: \"kubernetes.io/projected/04227e11-425b-4561-859c-11269b66825c-kube-api-access-7bdlx\") pod \"04227e11-425b-4561-859c-11269b66825c\" (UID: \"04227e11-425b-4561-859c-11269b66825c\") "
Sep 11 18:36:47.911163 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:47.911138    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04227e11-425b-4561-859c-11269b66825c-kube-api-access-7bdlx" (OuterVolumeSpecName: "kube-api-access-7bdlx") pod "04227e11-425b-4561-859c-11269b66825c" (UID: "04227e11-425b-4561-859c-11269b66825c"). InnerVolumeSpecName "kube-api-access-7bdlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:48.010738 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.010607    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdlx\" (UniqueName: \"kubernetes.io/projected/04227e11-425b-4561-859c-11269b66825c-kube-api-access-7bdlx\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:36:48.305627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.305593    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 18:36:48.305815 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.305649    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 18:36:48.327907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.327872    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7536-6c08d7"]
Sep 11 18:36:48.333191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.333154    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7536-6c08d7"]
Sep 11 18:36:48.470354 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.470287    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7536-6ea2cd"]
Sep 11 18:36:48.471363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.471335    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" containerName="test-curl-7536-6c08d7"
Sep 11 18:36:48.471504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.471375    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" containerName="test-curl-7536-6c08d7"
Sep 11 18:36:48.471569 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.471532    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" containerName="test-curl-7536-6c08d7"
Sep 11 18:36:48.473847 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.473825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:48.475385 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.475359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-6ea2cd"]
Sep 11 18:36:48.607078 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.606988    2561 generic.go:356] "Generic (PLEG): container finished" podID="04227e11-425b-4561-859c-11269b66825c" containerID="f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27" exitCode=137
Sep 11 18:36:48.607078 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.607044    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-5c83e6"
Sep 11 18:36:48.607518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.607097    2561 scope.go:117] "RemoveContainer" containerID="f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27"
Sep 11 18:36:48.607518 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:48.607434    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7536-6c08d7" container="test-curl-7536-6c08d7"
Sep 11 18:36:48.615649 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.615627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkvzf\" (UniqueName: \"kubernetes.io/projected/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6-kube-api-access-wkvzf\") pod \"test-curl-7536-6ea2cd\" (UID: \"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6\") " pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:48.617857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.617843    2561 scope.go:117] "RemoveContainer" containerID="f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27"
Sep 11 18:36:48.618123 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:48.618100    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27\": container with ID starting with f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27 not found: ID does not exist" containerID="f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27"
Sep 11 18:36:48.618166 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.618132    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27"} err="failed to get container status \"f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27\": rpc error: code = NotFound desc = could not find container \"f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27\": container with ID starting with f96d04774992976713af75884a8c47da9684905abddf6973ccc623552207ce27 not found: ID does not exist"
Sep 11 18:36:48.717203 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.717165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkvzf\" (UniqueName: \"kubernetes.io/projected/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6-kube-api-access-wkvzf\") pod \"test-curl-7536-6ea2cd\" (UID: \"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6\") " pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:48.732967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.732932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkvzf\" (UniqueName: \"kubernetes.io/projected/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6-kube-api-access-wkvzf\") pod \"test-curl-7536-6ea2cd\" (UID: \"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6\") " pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:48.784179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:48.784146    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:49.082477 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:36:49.082441    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74ce61b5_a81f_42e5_9f7f_090f8e26e5a6.slice/crio-758cf5e5111ba0393113ae066951203f4a524dd9d2382356e027d83ebc5074a3 WatchSource:0}: Error finding container 758cf5e5111ba0393113ae066951203f4a524dd9d2382356e027d83ebc5074a3: Status 404 returned error can't find the container with id 758cf5e5111ba0393113ae066951203f4a524dd9d2382356e027d83ebc5074a3
Sep 11 18:36:49.083011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.082992    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7536-6ea2cd"]
Sep 11 18:36:49.310140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.310108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:49.310548 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.310522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:49.311128 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.311111    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:36:49.615460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.615426    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-6ea2cd" event={"ID":"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6","Type":"ContainerStarted","Data":"d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4"}
Sep 11 18:36:49.615746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.615472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7536-6ea2cd" event={"ID":"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6","Type":"ContainerStarted","Data":"758cf5e5111ba0393113ae066951203f4a524dd9d2382356e027d83ebc5074a3"}
Sep 11 18:36:49.616781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.616757    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7536-6c08d7" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" containerName="test-curl-7536-6c08d7" containerID="cri-o://256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c" gracePeriod=2
Sep 11 18:36:49.632243 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:49.632209    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-6c08d7\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:49.633198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.633161    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7536-6ea2cd" podStartSLOduration=1.633146972 podStartE2EDuration="1.633146972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:49.630084434 +0000 UTC m=+1252.205187903" watchObservedRunningTime="2026-09-11 18:36:49.633146972 +0000 UTC m=+1252.208250439"
Sep 11 18:36:49.779186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.779150    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:49.783680 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:49.783655    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-6c08d7\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:49.829357 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.829323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm782\" (UniqueName: \"kubernetes.io/projected/5482ac40-2d11-475d-8419-b5c5f571ccf4-kube-api-access-qm782\") pod \"5482ac40-2d11-475d-8419-b5c5f571ccf4\" (UID: \"5482ac40-2d11-475d-8419-b5c5f571ccf4\") "
Sep 11 18:36:49.831416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.831392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5482ac40-2d11-475d-8419-b5c5f571ccf4-kube-api-access-qm782" (OuterVolumeSpecName: "kube-api-access-qm782") pod "5482ac40-2d11-475d-8419-b5c5f571ccf4" (UID: "5482ac40-2d11-475d-8419-b5c5f571ccf4"). InnerVolumeSpecName "kube-api-access-qm782". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:49.909008 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.908924    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04227e11-425b-4561-859c-11269b66825c" path="/var/lib/kubelet/pods/04227e11-425b-4561-859c-11269b66825c/volumes"
Sep 11 18:36:49.909374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.909357    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5482ac40-2d11-475d-8419-b5c5f571ccf4" path="/var/lib/kubelet/pods/5482ac40-2d11-475d-8419-b5c5f571ccf4/volumes"
Sep 11 18:36:49.930486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:49.930456    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm782\" (UniqueName: \"kubernetes.io/projected/5482ac40-2d11-475d-8419-b5c5f571ccf4-kube-api-access-qm782\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:36:50.224496 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.224384    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7536-6ea2cd"]
Sep 11 18:36:50.229772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.229741    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7536-6ea2cd"]
Sep 11 18:36:50.624137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.624100    2561 generic.go:356] "Generic (PLEG): container finished" podID="5482ac40-2d11-475d-8419-b5c5f571ccf4" containerID="5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749" exitCode=137
Sep 11 18:36:50.624591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.624153    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-2c91df"
Sep 11 18:36:50.624591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.624208    2561 scope.go:117] "RemoveContainer" containerID="5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749"
Sep 11 18:36:50.624591 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:50.624529    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7536-6ea2cd" container="test-curl-7536-6ea2cd"
Sep 11 18:36:50.633939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.633921    2561 scope.go:117] "RemoveContainer" containerID="5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749"
Sep 11 18:36:50.634198 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:50.634180    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749\": container with ID starting with 5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749 not found: ID does not exist" containerID="5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749"
Sep 11 18:36:50.634253 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.634209    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749"} err="failed to get container status \"5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749\": rpc error: code = NotFound desc = could not find container \"5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749\": container with ID starting with 5f1cebbb75cb8520f6916a1fa855062e8dafb0163ffda9e4646469f0fb1b1749 not found: ID does not exist"
Sep 11 18:36:50.823535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:50.823501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:51.111187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.111150    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"]
Sep 11 18:36:51.111795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.111771    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" containerName="test-curl-7536-6ea2cd"
Sep 11 18:36:51.111795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.111795    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" containerName="test-curl-7536-6ea2cd"
Sep 11 18:36:51.111960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.111902    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" containerName="test-curl-7536-6ea2cd"
Sep 11 18:36:51.114805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.114787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.117895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.117874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8d2ddf84-openshift-default-dockercfg-v6xkr\""
Sep 11 18:36:51.130955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.130926    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"]
Sep 11 18:36:51.139622 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb596a17-fe25-4c21-a66d-2894c4c4a105-istiod-ca-cert\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-podinfo\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7tqk\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-kube-api-access-v7tqk\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-envoy\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-credential-socket\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-token\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-data\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.139993 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-socket\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.140036 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.139994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-certs\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.144676 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.144648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:51.241206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-socket\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-certs\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb596a17-fe25-4c21-a66d-2894c4c4a105-istiod-ca-cert\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241396 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-podinfo\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7tqk\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-kube-api-access-v7tqk\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241505    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-envoy\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-credential-socket\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.241595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-token\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.242019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.241691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-data\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.242220 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.242150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-data\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.242471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.242440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-socket\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.242984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.242958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-certs\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.243782 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.243752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb596a17-fe25-4c21-a66d-2894c4c4a105-istiod-ca-cert\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.244004 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.243982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-credential-socket\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.246160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.246140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-envoy\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.246419 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.246399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-podinfo\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.252595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.252573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7tqk\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-kube-api-access-v7tqk\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.252676 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.252654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-token\") pod \"e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") " pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.425898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.425802    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:51.632253 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.632216    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7536-6ea2cd" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" containerName="test-curl-7536-6ea2cd" containerID="cri-o://d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4" gracePeriod=2
Sep 11 18:36:51.634927 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:51.634902    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-6ea2cd\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:51.706793 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.706761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"]
Sep 11 18:36:51.707639 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:36:51.707609    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb596a17_fe25_4c21_a66d_2894c4c4a105.slice/crio-e1bbd3fb046eb4e9bf0813be746e20388b4afeff644a67a4177c1bd519a0d859 WatchSource:0}: Error finding container e1bbd3fb046eb4e9bf0813be746e20388b4afeff644a67a4177c1bd519a0d859: Status 404 returned error can't find the container with id e1bbd3fb046eb4e9bf0813be746e20388b4afeff644a67a4177c1bd519a0d859
Sep 11 18:36:51.710440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.710405    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:51.710556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.710486    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:51.710556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.710533    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:36:51.787099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.787075    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:51.789532 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:51.789490    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7536-6ea2cd\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:51.850450 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.850417    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v28n\" (UniqueName: \"kubernetes.io/projected/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5-kube-api-access-8v28n\") pod \"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5\" (UID: \"b25f1bbd-e6a5-461c-b14e-43c5bc6613e5\") "
Sep 11 18:36:51.852453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.852425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5-kube-api-access-8v28n" (OuterVolumeSpecName: "kube-api-access-8v28n") pod "b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" (UID: "b25f1bbd-e6a5-461c-b14e-43c5bc6613e5"). InnerVolumeSpecName "kube-api-access-8v28n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:51.889434 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.889394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:51.909849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.909817    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" path="/var/lib/kubelet/pods/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5/volumes"
Sep 11 18:36:51.952388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:51.952348    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v28n\" (UniqueName: \"kubernetes.io/projected/b25f1bbd-e6a5-461c-b14e-43c5bc6613e5-kube-api-access-8v28n\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:36:52.641158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.641061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" event={"ID":"cb596a17-fe25-4c21-a66d-2894c4c4a105","Type":"ContainerStarted","Data":"6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"}
Sep 11 18:36:52.641158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.641120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" event={"ID":"cb596a17-fe25-4c21-a66d-2894c4c4a105","Type":"ContainerStarted","Data":"e1bbd3fb046eb4e9bf0813be746e20388b4afeff644a67a4177c1bd519a0d859"}
Sep 11 18:36:52.642489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.642463    2561 generic.go:356] "Generic (PLEG): container finished" podID="b25f1bbd-e6a5-461c-b14e-43c5bc6613e5" containerID="256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c" exitCode=137
Sep 11 18:36:52.642601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.642497    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6c08d7"
Sep 11 18:36:52.642601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.642565    2561 scope.go:117] "RemoveContainer" containerID="256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c"
Sep 11 18:36:52.654679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.654662    2561 scope.go:117] "RemoveContainer" containerID="256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c"
Sep 11 18:36:52.654962 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:52.654943    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c\": container with ID starting with 256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c not found: ID does not exist" containerID="256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c"
Sep 11 18:36:52.655035 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.654972    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c"} err="failed to get container status \"256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c\": rpc error: code = NotFound desc = could not find container \"256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c\": container with ID starting with 256c3a8cb6d497d5ccb45d17ac76bf4405ba80117f273a2bbddd538119a5114c not found: ID does not exist"
Sep 11 18:36:52.671751 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:52.671706    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podStartSLOduration=1.671691707 podStartE2EDuration="1.671691707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:36:52.668931493 +0000 UTC m=+1255.244034960" watchObservedRunningTime="2026-09-11 18:36:52.671691707 +0000 UTC m=+1255.246795175"
Sep 11 18:36:53.426392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.426354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:53.431726 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.431698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:53.652594 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.652563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:53.653544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.653525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:36:53.834664 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.834640    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:53.873067 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.873031    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkvzf\" (UniqueName: \"kubernetes.io/projected/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6-kube-api-access-wkvzf\") pod \"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6\" (UID: \"74ce61b5-a81f-42e5-9f7f-090f8e26e5a6\") "
Sep 11 18:36:53.875160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.875133    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6-kube-api-access-wkvzf" (OuterVolumeSpecName: "kube-api-access-wkvzf") pod "74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" (UID: "74ce61b5-a81f-42e5-9f7f-090f8e26e5a6"). InnerVolumeSpecName "kube-api-access-wkvzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:36:53.909480 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.909443    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" path="/var/lib/kubelet/pods/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6/volumes"
Sep 11 18:36:53.975007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.974916    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkvzf\" (UniqueName: \"kubernetes.io/projected/74ce61b5-a81f-42e5-9f7f-090f8e26e5a6-kube-api-access-wkvzf\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:36:53.991791 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:53.991762    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:54.660071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.660033    2561 generic.go:356] "Generic (PLEG): container finished" podID="74ce61b5-a81f-42e5-9f7f-090f8e26e5a6" containerID="d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4" exitCode=137
Sep 11 18:36:54.660584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.660073    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7536-6ea2cd"
Sep 11 18:36:54.660584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.660132    2561 scope.go:117] "RemoveContainer" containerID="d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4"
Sep 11 18:36:54.664976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.664952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:54.670743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.670726    2561 scope.go:117] "RemoveContainer" containerID="d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4"
Sep 11 18:36:54.671004 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:36:54.670985    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4\": container with ID starting with d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4 not found: ID does not exist" containerID="d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4"
Sep 11 18:36:54.671078 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.671015    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4"} err="failed to get container status \"d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4\": rpc error: code = NotFound desc = could not find container \"d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4\": container with ID starting with d0e2dee977ac25bb4816288f27fe1fe3e2c4fb253cea2a9bbbb655e6793443c4 not found: ID does not exist"
Sep 11 18:36:54.764596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.764558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:54.863513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:54.863468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:55.867501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:55.867467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:57.057882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:57.057842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:57.839632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:57.839598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:58.049316 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:58.049275    2561 scope.go:117] "RemoveContainer" containerID="daa5f1af561fee6da26214f870fa48167b9d240db32cd3bdcf19faf5811295f0"
Sep 11 18:36:58.489037 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:58.489001    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:58.881812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:58.881772    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:36:59.792511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:36:59.792479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:00.541522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:00.541487    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:00.645564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:00.645520    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:00.744588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:00.744548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:01.132524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:01.132488    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:01.238105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:01.238072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:07.137963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:07.137926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:15.914353 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:15.914320    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"]
Sep 11 18:37:15.914840 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:15.914520    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c" podUID="fec78865-d3f4-4468-9c1d-b5e7a4442883" containerName="istio-proxy" containerID="cri-o://f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e" gracePeriod=30
Sep 11 18:37:15.940033 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:15.940002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:16.155636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:16.155600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:16.283064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:16.283025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:17.956915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:17.956875    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"]
Sep 11 18:37:17.966629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:17.966598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:19.627410 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:19.627371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:21.182662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.182588    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:37:21.287772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287735    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-data\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.287976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287819    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-envoy\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.287976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287876    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fec78865-d3f4-4468-9c1d-b5e7a4442883-istiod-ca-cert\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.287976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287904    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-token\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.287976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-certs\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.287976 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287958    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-podinfo\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.288238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.287981    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-data" (OuterVolumeSpecName: "istio-data") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.288238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288029    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-credential-socket\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.288238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-socket\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.288238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288146    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6wwq\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-kube-api-access-c6wwq\") pod \"fec78865-d3f4-4468-9c1d-b5e7a4442883\" (UID: \"fec78865-d3f4-4468-9c1d-b5e7a4442883\") "
Sep 11 18:37:21.288497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288244    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.288497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.288497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.288663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288644    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.288723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288670    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.288723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288685    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.288723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288700    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.288890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.288844    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec78865-d3f4-4468-9c1d-b5e7a4442883-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:21.290238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.290212    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:37:21.290374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.290220    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-kube-api-access-c6wwq" (OuterVolumeSpecName: "kube-api-access-c6wwq") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "kube-api-access-c6wwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:21.290609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.290590    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-token" (OuterVolumeSpecName: "istio-token") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:21.290681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.290591    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fec78865-d3f4-4468-9c1d-b5e7a4442883" (UID: "fec78865-d3f4-4468-9c1d-b5e7a4442883"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:21.302845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.302824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:21.389785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.389747    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6wwq\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-kube-api-access-c6wwq\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.389785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.389780    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.389785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.389791    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fec78865-d3f4-4468-9c1d-b5e7a4442883-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.390013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.389803    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.390013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.389814    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fec78865-d3f4-4468-9c1d-b5e7a4442883-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:21.577127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.577087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:21.859453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.859361    2561 generic.go:356] "Generic (PLEG): container finished" podID="fec78865-d3f4-4468-9c1d-b5e7a4442883" containerID="f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e" exitCode=0
Sep 11 18:37:21.859453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.859412    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"
Sep 11 18:37:21.859671 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.859413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c" event={"ID":"fec78865-d3f4-4468-9c1d-b5e7a4442883","Type":"ContainerDied","Data":"f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e"}
Sep 11 18:37:21.859671 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.859544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c" event={"ID":"fec78865-d3f4-4468-9c1d-b5e7a4442883","Type":"ContainerDied","Data":"38edeac7035c102267c8f9cae2dcc5f361a726843a0e1739806eaae53b55cc7f"}
Sep 11 18:37:21.859671 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.859577    2561 scope.go:117] "RemoveContainer" containerID="f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e"
Sep 11 18:37:21.870483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.870463    2561 scope.go:117] "RemoveContainer" containerID="f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e"
Sep 11 18:37:21.870778 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:37:21.870758    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e\": container with ID starting with f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e not found: ID does not exist" containerID="f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e"
Sep 11 18:37:21.870817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.870791    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e"} err="failed to get container status \"f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e\": rpc error: code = NotFound desc = could not find container \"f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e\": container with ID starting with f39e0d0b5316171eb593d4f2e071d3ac6fc2b40657187e887f53f7fc8492cc8e not found: ID does not exist"
Sep 11 18:37:21.885176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.885148    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"]
Sep 11 18:37:21.889618 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.889592    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c"]
Sep 11 18:37:21.909222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:21.909195    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec78865-d3f4-4468-9c1d-b5e7a4442883" path="/var/lib/kubelet/pods/fec78865-d3f4-4468-9c1d-b5e7a4442883/volumes"
Sep 11 18:37:22.968613 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:22.968577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:23.746297 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:23.746260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:24.685924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:24.685886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:24.786858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:24.786824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:25.569984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:25.569947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:26.386636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:26.386601    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:27.351757 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:27.351697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:28.251453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:28.251405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:29.370487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:29.370371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:32.976629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:32.976591    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p" podUID="589a0591-17f6-4255-a182-7a742b9695ff" containerName="main" containerID="cri-o://2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e" gracePeriod=45
Sep 11 18:37:33.261388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.261355    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:37:33.317007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.316972    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-home\") pod \"589a0591-17f6-4255-a182-7a742b9695ff\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") "
Sep 11 18:37:33.317007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-model-cache\") pod \"589a0591-17f6-4255-a182-7a742b9695ff\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") "
Sep 11 18:37:33.317274 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-tmp-dir\") pod \"589a0591-17f6-4255-a182-7a742b9695ff\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") "
Sep 11 18:37:33.317274 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317069    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-dshm\") pod \"589a0591-17f6-4255-a182-7a742b9695ff\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") "
Sep 11 18:37:33.317274 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317135    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmc85\" (UniqueName: \"kubernetes.io/projected/589a0591-17f6-4255-a182-7a742b9695ff-kube-api-access-kmc85\") pod \"589a0591-17f6-4255-a182-7a742b9695ff\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") "
Sep 11 18:37:33.317274 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317177    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/589a0591-17f6-4255-a182-7a742b9695ff-tls-certs\") pod \"589a0591-17f6-4255-a182-7a742b9695ff\" (UID: \"589a0591-17f6-4255-a182-7a742b9695ff\") "
Sep 11 18:37:33.317530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-home" (OuterVolumeSpecName: "home") pod "589a0591-17f6-4255-a182-7a742b9695ff" (UID: "589a0591-17f6-4255-a182-7a742b9695ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:33.317530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317329    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "589a0591-17f6-4255-a182-7a742b9695ff" (UID: "589a0591-17f6-4255-a182-7a742b9695ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:33.317530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "589a0591-17f6-4255-a182-7a742b9695ff" (UID: "589a0591-17f6-4255-a182-7a742b9695ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:33.317705 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317611    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:33.317705 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317629    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:33.317705 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.317643    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:33.319481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.319450    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/589a0591-17f6-4255-a182-7a742b9695ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "589a0591-17f6-4255-a182-7a742b9695ff" (UID: "589a0591-17f6-4255-a182-7a742b9695ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:37:33.319481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.319460    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589a0591-17f6-4255-a182-7a742b9695ff-kube-api-access-kmc85" (OuterVolumeSpecName: "kube-api-access-kmc85") pod "589a0591-17f6-4255-a182-7a742b9695ff" (UID: "589a0591-17f6-4255-a182-7a742b9695ff"). InnerVolumeSpecName "kube-api-access-kmc85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:33.319631 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.319507    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-dshm" (OuterVolumeSpecName: "dshm") pod "589a0591-17f6-4255-a182-7a742b9695ff" (UID: "589a0591-17f6-4255-a182-7a742b9695ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:33.419038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.419002    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/589a0591-17f6-4255-a182-7a742b9695ff-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:33.419038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.419031    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmc85\" (UniqueName: \"kubernetes.io/projected/589a0591-17f6-4255-a182-7a742b9695ff-kube-api-access-kmc85\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:33.419038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.419042    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/589a0591-17f6-4255-a182-7a742b9695ff-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:33.949573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.948071    2561 generic.go:356] "Generic (PLEG): container finished" podID="589a0591-17f6-4255-a182-7a742b9695ff" containerID="2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e" exitCode=0
Sep 11 18:37:33.949573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.948185    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p" event={"ID":"589a0591-17f6-4255-a182-7a742b9695ff","Type":"ContainerDied","Data":"2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e"}
Sep 11 18:37:33.949573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.948221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p" event={"ID":"589a0591-17f6-4255-a182-7a742b9695ff","Type":"ContainerDied","Data":"12483b5f5d02f16e1ca8ab57cf760901d076cd49600ccb0294d779662540ec46"}
Sep 11 18:37:33.949573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.948243    2561 scope.go:117] "RemoveContainer" containerID="2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e"
Sep 11 18:37:33.949573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.948423    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"
Sep 11 18:37:33.977094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.976619    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"]
Sep 11 18:37:33.978294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.978272    2561 scope.go:117] "RemoveContainer" containerID="2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e"
Sep 11 18:37:33.978762 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:37:33.978739    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e\": container with ID starting with 2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e not found: ID does not exist" containerID="2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e"
Sep 11 18:37:33.978851 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.978771    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e"} err="failed to get container status \"2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e\": rpc error: code = NotFound desc = could not find container \"2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e\": container with ID starting with 2a874e0cba9e4a9a6560627b0c077c76b01c746751b705bf3083b95213d6be0e not found: ID does not exist"
Sep 11 18:37:33.981622 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:33.981602    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-52b585/test-model-52b585-kserve-c449f6bdc-xxn8p"]
Sep 11 18:37:35.704725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.704685    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"]
Sep 11 18:37:35.717500 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.717463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:35.832525 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.832493    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"]
Sep 11 18:37:35.833008 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.832994    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec78865-d3f4-4468-9c1d-b5e7a4442883" containerName="istio-proxy"
Sep 11 18:37:35.833057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.833010    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec78865-d3f4-4468-9c1d-b5e7a4442883" containerName="istio-proxy"
Sep 11 18:37:35.833057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.833024    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589a0591-17f6-4255-a182-7a742b9695ff" containerName="main"
Sep 11 18:37:35.833057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.833029    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="589a0591-17f6-4255-a182-7a742b9695ff" containerName="main"
Sep 11 18:37:35.833160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.833100    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="589a0591-17f6-4255-a182-7a742b9695ff" containerName="main"
Sep 11 18:37:35.833160 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.833109    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec78865-d3f4-4468-9c1d-b5e7a4442883" containerName="istio-proxy"
Sep 11 18:37:35.837550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.837527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:35.840703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.840687    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:37:35.848425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.848396    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"]
Sep 11 18:37:35.909418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.909381    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="589a0591-17f6-4255-a182-7a742b9695ff" path="/var/lib/kubelet/pods/589a0591-17f6-4255-a182-7a742b9695ff/volumes"
Sep 11 18:37:35.948385 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:35.948340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eee7c4-d91c-49a7-a043-e17be9cb54c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs\" (UID: \"a1eee7c4-d91c-49a7-a043-e17be9cb54c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:36.011297 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.011260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:36.049250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.049217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eee7c4-d91c-49a7-a043-e17be9cb54c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs\" (UID: \"a1eee7c4-d91c-49a7-a043-e17be9cb54c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:36.049966 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.049947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eee7c4-d91c-49a7-a043-e17be9cb54c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs\" (UID: \"a1eee7c4-d91c-49a7-a043-e17be9cb54c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:36.152889 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.152846    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:36.237902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.237858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:36.341170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.341091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:36.431843 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.431816    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"]
Sep 11 18:37:36.434294 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:37:36.434256    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1eee7c4_d91c_49a7_a043_e17be9cb54c5.slice/crio-eccca274943157e90d616d2ba5e06ea34c0b3ab5e579322968d2ad594fa00c1e WatchSource:0}: Error finding container eccca274943157e90d616d2ba5e06ea34c0b3ab5e579322968d2ad594fa00c1e: Status 404 returned error can't find the container with id eccca274943157e90d616d2ba5e06ea34c0b3ab5e579322968d2ad594fa00c1e
Sep 11 18:37:36.806096 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.806063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:36.974116 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.974025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs" event={"ID":"a1eee7c4-d91c-49a7-a043-e17be9cb54c5","Type":"ContainerStarted","Data":"97d32772466d520789ae27b3983575c94c7dbd05621f3de766e3686e2e863e17"}
Sep 11 18:37:36.974116 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.974087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs" event={"ID":"a1eee7c4-d91c-49a7-a043-e17be9cb54c5","Type":"ContainerStarted","Data":"eccca274943157e90d616d2ba5e06ea34c0b3ab5e579322968d2ad594fa00c1e"}
Sep 11 18:37:36.998638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:36.998585    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs" podStartSLOduration=1.9985685100000001 podStartE2EDuration="1.99856851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:37:36.995570799 +0000 UTC m=+1299.570674267" watchObservedRunningTime="2026-09-11 18:37:36.99856851 +0000 UTC m=+1299.573671977"
Sep 11 18:37:37.647342 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.647278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:37.983003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.982900    2561 generic.go:356] "Generic (PLEG): container finished" podID="a1eee7c4-d91c-49a7-a043-e17be9cb54c5" containerID="97d32772466d520789ae27b3983575c94c7dbd05621f3de766e3686e2e863e17" exitCode=0
Sep 11 18:37:37.983003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.982981    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs" event={"ID":"a1eee7c4-d91c-49a7-a043-e17be9cb54c5","Type":"ContainerDied","Data":"97d32772466d520789ae27b3983575c94c7dbd05621f3de766e3686e2e863e17"}
Sep 11 18:37:37.984765 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.984742    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerID="6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394" exitCode=0
Sep 11 18:37:37.984867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.984773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" event={"ID":"cb596a17-fe25-4c21-a66d-2894c4c4a105","Type":"ContainerDied","Data":"6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"}
Sep 11 18:37:37.985185 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.985172    2561 scope.go:117] "RemoveContainer" containerID="6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"
Sep 11 18:37:37.986464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.986435    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:37:37.986552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.986503    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:37:37.986552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:37.986534    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:37:38.436802 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:38.436754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:38.653274 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:38.653234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:37:38.993997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:38.993958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" event={"ID":"cb596a17-fe25-4c21-a66d-2894c4c4a105","Type":"ContainerStarted","Data":"70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe"}
Sep 11 18:37:39.182253 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.182224    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:39.288120 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.288085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eee7c4-d91c-49a7-a043-e17be9cb54c5-maas-api-service-ca\") pod \"a1eee7c4-d91c-49a7-a043-e17be9cb54c5\" (UID: \"a1eee7c4-d91c-49a7-a043-e17be9cb54c5\") "
Sep 11 18:37:39.288472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.288445    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1eee7c4-d91c-49a7-a043-e17be9cb54c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1eee7c4-d91c-49a7-a043-e17be9cb54c5" (UID: "a1eee7c4-d91c-49a7-a043-e17be9cb54c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:39.316639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.316600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:39.389038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.389003    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eee7c4-d91c-49a7-a043-e17be9cb54c5-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:39.426559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.426521    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:37:39.427931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.427903    2561 patch_prober.go:28] interesting pod/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 18:37:39.428027 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:39.427957    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 18:37:40.002291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:40.002266    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"
Sep 11 18:37:40.002291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:40.002261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs" event={"ID":"a1eee7c4-d91c-49a7-a043-e17be9cb54c5","Type":"ContainerDied","Data":"eccca274943157e90d616d2ba5e06ea34c0b3ab5e579322968d2ad594fa00c1e"}
Sep 11 18:37:40.002758 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:40.002360    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eccca274943157e90d616d2ba5e06ea34c0b3ab5e579322968d2ad594fa00c1e"
Sep 11 18:37:40.325613 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:40.325576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:40.426601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:40.426564    2561 patch_prober.go:28] interesting pod/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 18:37:40.426755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:40.426625    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 18:37:41.151210 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:41.151166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:41.426644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:41.426556    2561 patch_prober.go:28] interesting pod/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 18:37:41.426644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:41.426617    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 18:37:42.169357 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.169318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:42.341683 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.341651    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"]
Sep 11 18:37:42.342165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.342148    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1eee7c4-d91c-49a7-a043-e17be9cb54c5" containerName="revoke-keys"
Sep 11 18:37:42.342165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.342166    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1eee7c4-d91c-49a7-a043-e17be9cb54c5" containerName="revoke-keys"
Sep 11 18:37:42.342347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.342284    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1eee7c4-d91c-49a7-a043-e17be9cb54c5" containerName="revoke-keys"
Sep 11 18:37:42.358227 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.358198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.370460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.367747    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-c8b274\"/\"default-dockercfg-wnwtz\""
Sep 11 18:37:42.370460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.368027    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-c8b274\"/\"e2e-conflict-b-fbdeb325-kserve-self-signed-certs\""
Sep 11 18:37:42.370460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.368609    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-c8b274\"/\"kube-root-ca.crt\""
Sep 11 18:37:42.370460 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.368860    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-c8b274\"/\"openshift-service-ca.crt\""
Sep 11 18:37:42.386596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.386563    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"]
Sep 11 18:37:42.393666 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.393639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:42.426197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.426117    2561 patch_prober.go:28] interesting pod/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 18:37:42.426197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.426176    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 18:37:42.522717 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.522678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwjmr\" (UniqueName: \"kubernetes.io/projected/7ef1463a-c78a-4057-95a7-897dd6984237-kube-api-access-jwjmr\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.522893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.522806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-dshm\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.522893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.522850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-model-cache\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.522893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.522867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-tmp-dir\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.523062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.522924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-home\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.523062 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.522938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef1463a-c78a-4057-95a7-897dd6984237-tls-certs\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.624442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.624402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-dshm\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.624729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.624708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-model-cache\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.624841 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.624829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-tmp-dir\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.624997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.624978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-home\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.625108 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.625093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef1463a-c78a-4057-95a7-897dd6984237-tls-certs\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.625349 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.625316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwjmr\" (UniqueName: \"kubernetes.io/projected/7ef1463a-c78a-4057-95a7-897dd6984237-kube-api-access-jwjmr\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.626777 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.626756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-tmp-dir\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.626906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.626826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-home\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.627079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.627045    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-model-cache\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.628805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.628737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-dshm\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.630235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.630194    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef1463a-c78a-4057-95a7-897dd6984237-tls-certs\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.641292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.641264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwjmr\" (UniqueName: \"kubernetes.io/projected/7ef1463a-c78a-4057-95a7-897dd6984237-kube-api-access-jwjmr\") pod \"e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") " pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:42.684290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:42.684198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:43.010395 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:43.010366    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"]
Sep 11 18:37:43.037194 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:43.037162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7" event={"ID":"7ef1463a-c78a-4057-95a7-897dd6984237","Type":"ContainerStarted","Data":"d2fe173dca8fc12549f94555de67c68a67ad7425c977068d14e41e29d5ca7a31"}
Sep 11 18:37:43.390275 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:43.390144    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:43.426604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:43.426565    2561 patch_prober.go:28] interesting pod/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 18:37:43.426779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:43.426624    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 18:37:44.045890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:44.045848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7" event={"ID":"7ef1463a-c78a-4057-95a7-897dd6984237","Type":"ContainerStarted","Data":"d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de"}
Sep 11 18:37:44.070453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:44.070378    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7" podStartSLOduration=2.070353407 podStartE2EDuration="2.070353407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:37:44.066582892 +0000 UTC m=+1306.641686359" watchObservedRunningTime="2026-09-11 18:37:44.070353407 +0000 UTC m=+1306.645457079"
Sep 11 18:37:44.431480 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:44.431383    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:37:44.431915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:44.431753    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:37:44.432508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:44.432487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:37:46.683562 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:46.683527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:46.774749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:46.774711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:46.877021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:46.876985    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:46.913374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:46.913343    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"]
Sep 11 18:37:46.917523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:46.917496    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-52b585-2fbvs"]
Sep 11 18:37:46.946583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:46.946494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:47.271575 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:47.271539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:47.372655 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:47.372614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:47.910157 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:47.910125    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1eee7c4-d91c-49a7-a043-e17be9cb54c5" path="/var/lib/kubelet/pods/a1eee7c4-d91c-49a7-a043-e17be9cb54c5/volumes"
Sep 11 18:37:48.042285 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:48.042241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:49.019149 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:49.019111    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:49.769137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:49.769096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:50.443101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:50.443068    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:50.724412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:50.724297    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h" podUID="3fd7bdbc-c342-4f69-8334-05cb35c69c8e" containerName="main" containerID="cri-o://c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189" gracePeriod=45
Sep 11 18:37:50.969954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:50.969931    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:37:51.102500 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.102467    2561 generic.go:356] "Generic (PLEG): container finished" podID="3fd7bdbc-c342-4f69-8334-05cb35c69c8e" containerID="c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189" exitCode=0
Sep 11 18:37:51.102717 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.102521    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"
Sep 11 18:37:51.102717 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.102560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h" event={"ID":"3fd7bdbc-c342-4f69-8334-05cb35c69c8e","Type":"ContainerDied","Data":"c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189"}
Sep 11 18:37:51.102717 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.102601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h" event={"ID":"3fd7bdbc-c342-4f69-8334-05cb35c69c8e","Type":"ContainerDied","Data":"0d2bc1ae0317b2ee162eacec6ed73bbf61ecde384640a625a1f586139b9b7210"}
Sep 11 18:37:51.102717 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.102621    2561 scope.go:117] "RemoveContainer" containerID="c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189"
Sep 11 18:37:51.112053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.112036    2561 scope.go:117] "RemoveContainer" containerID="c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189"
Sep 11 18:37:51.112351 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:37:51.112333    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189\": container with ID starting with c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189 not found: ID does not exist" containerID="c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189"
Sep 11 18:37:51.112434 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.112358    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189"} err="failed to get container status \"c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189\": rpc error: code = NotFound desc = could not find container \"c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189\": container with ID starting with c0ca0649be17562eb0488c6f5ad4dc1bd0fd69dbf45141492baf592d19c09189 not found: ID does not exist"
Sep 11 18:37:51.121262 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9crzj\" (UniqueName: \"kubernetes.io/projected/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-kube-api-access-9crzj\") pod \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") "
Sep 11 18:37:51.121328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tmp-dir\") pod \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") "
Sep 11 18:37:51.121328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121318    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tls-certs\") pod \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") "
Sep 11 18:37:51.121399 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-home\") pod \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") "
Sep 11 18:37:51.121449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121436    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-dshm\") pod \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") "
Sep 11 18:37:51.121512 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121493    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-model-cache\") pod \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\" (UID: \"3fd7bdbc-c342-4f69-8334-05cb35c69c8e\") "
Sep 11 18:37:51.121570 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121537    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fd7bdbc-c342-4f69-8334-05cb35c69c8e" (UID: "3fd7bdbc-c342-4f69-8334-05cb35c69c8e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:51.121731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-home" (OuterVolumeSpecName: "home") pod "3fd7bdbc-c342-4f69-8334-05cb35c69c8e" (UID: "3fd7bdbc-c342-4f69-8334-05cb35c69c8e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:51.121836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121769    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fd7bdbc-c342-4f69-8334-05cb35c69c8e" (UID: "3fd7bdbc-c342-4f69-8334-05cb35c69c8e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:51.121911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121881    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:51.122012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121912    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:51.122012 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.121926    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:51.123573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.123546    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-dshm" (OuterVolumeSpecName: "dshm") pod "3fd7bdbc-c342-4f69-8334-05cb35c69c8e" (UID: "3fd7bdbc-c342-4f69-8334-05cb35c69c8e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:37:51.123682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.123565    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-kube-api-access-9crzj" (OuterVolumeSpecName: "kube-api-access-9crzj") pod "3fd7bdbc-c342-4f69-8334-05cb35c69c8e" (UID: "3fd7bdbc-c342-4f69-8334-05cb35c69c8e"). InnerVolumeSpecName "kube-api-access-9crzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:37:51.123682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.123644    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fd7bdbc-c342-4f69-8334-05cb35c69c8e" (UID: "3fd7bdbc-c342-4f69-8334-05cb35c69c8e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:37:51.223070 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.223037    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9crzj\" (UniqueName: \"kubernetes.io/projected/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-kube-api-access-9crzj\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:51.223070 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.223064    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:51.223070 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.223077    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd7bdbc-c342-4f69-8334-05cb35c69c8e-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:51.242141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.242103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:51.427453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.427426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"]
Sep 11 18:37:51.432249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.432223    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-0d18cc/test-model-0d18cc-kserve-777787785f-hw49h"]
Sep 11 18:37:51.909647 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.909609    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fd7bdbc-c342-4f69-8334-05cb35c69c8e" path="/var/lib/kubelet/pods/3fd7bdbc-c342-4f69-8334-05cb35c69c8e/volumes"
Sep 11 18:37:51.948082 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:51.948041    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:52.684584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:52.684542    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:52.684584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:52.684595    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:52.697725 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:52.697698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:53.136231 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:53.136185    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:37:53.647629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:53.647590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:53.724033 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:53.723999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:53.932892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:53.932786    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:54.241092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.241010    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"]
Sep 11 18:37:54.241509 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.241499    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd7bdbc-c342-4f69-8334-05cb35c69c8e" containerName="main"
Sep 11 18:37:54.241555 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.241512    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd7bdbc-c342-4f69-8334-05cb35c69c8e" containerName="main"
Sep 11 18:37:54.241620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.241609    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fd7bdbc-c342-4f69-8334-05cb35c69c8e" containerName="main"
Sep 11 18:37:54.244483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.244462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:54.247099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.247075    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:37:54.253695 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.253666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55\" (UID: \"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:54.254071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.254050    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"]
Sep 11 18:37:54.354629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.354593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55\" (UID: \"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:54.355196 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.355178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55\" (UID: \"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:54.543785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.543748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:54.560691 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.560664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:54.850549 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:54.850514    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"]
Sep 11 18:37:54.851667 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:37:54.851634    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc337abc5_ef6e_4e1a_ab54_5643fac1ee0e.slice/crio-939d7e6c26f6df93325f0c2bd8d7505b30708d4be212ad21269db829617c6e84 WatchSource:0}: Error finding container 939d7e6c26f6df93325f0c2bd8d7505b30708d4be212ad21269db829617c6e84: Status 404 returned error can't find the container with id 939d7e6c26f6df93325f0c2bd8d7505b30708d4be212ad21269db829617c6e84
Sep 11 18:37:55.142314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:55.142221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55" event={"ID":"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e","Type":"ContainerStarted","Data":"939d7e6c26f6df93325f0c2bd8d7505b30708d4be212ad21269db829617c6e84"}
Sep 11 18:37:55.438282 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:55.438185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:56.137354 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:56.137314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:56.151525 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:56.151497    2561 generic.go:356] "Generic (PLEG): container finished" podID="c337abc5-ef6e-4e1a-ab54-5643fac1ee0e" containerID="16f58a434d155c1990524c3c39691084f00796de8426eed88a7fe0fe19114be2" exitCode=0
Sep 11 18:37:56.151673 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:56.151575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55" event={"ID":"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e","Type":"ContainerDied","Data":"16f58a434d155c1990524c3c39691084f00796de8426eed88a7fe0fe19114be2"}
Sep 11 18:37:56.934109 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:56.934072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:57.325962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:57.325938    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:57.385020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:57.384988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e-maas-api-service-ca\") pod \"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e\" (UID: \"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e\") "
Sep 11 18:37:57.385329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:57.385287    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c337abc5-ef6e-4e1a-ab54-5643fac1ee0e" (UID: "c337abc5-ef6e-4e1a-ab54-5643fac1ee0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:37:57.385416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:57.385403    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:37:57.843169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:57.843136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:58.092676 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.092645    2561 scope.go:117] "RemoveContainer" containerID="888ffe4b72256ce5b842d3f92245204bffefd90a25ba1b1a064fd1644dcc93bb"
Sep 11 18:37:58.103256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.103233    2561 scope.go:117] "RemoveContainer" containerID="147fa58b175f92fdfedbe4058228c9bd54604b05cf26c16b1e7e121955ddd99c"
Sep 11 18:37:58.165169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.165136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55" event={"ID":"c337abc5-ef6e-4e1a-ab54-5643fac1ee0e","Type":"ContainerDied","Data":"939d7e6c26f6df93325f0c2bd8d7505b30708d4be212ad21269db829617c6e84"}
Sep 11 18:37:58.165169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.165163    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"
Sep 11 18:37:58.165391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.165183    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="939d7e6c26f6df93325f0c2bd8d7505b30708d4be212ad21269db829617c6e84"
Sep 11 18:37:58.480058 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.479970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:58.580641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:58.580607    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:37:59.450740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:37:59.450706    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:00.267229 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:00.267187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:03.243768 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.243733    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"]
Sep 11 18:38:03.244267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.244252    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c337abc5-ef6e-4e1a-ab54-5643fac1ee0e" containerName="revoke-keys"
Sep 11 18:38:03.244267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.244267    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c337abc5-ef6e-4e1a-ab54-5643fac1ee0e" containerName="revoke-keys"
Sep 11 18:38:03.244388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.244377    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c337abc5-ef6e-4e1a-ab54-5643fac1ee0e" containerName="revoke-keys"
Sep 11 18:38:03.249442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.249414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.253870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.253844    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8d2ddf84\"/\"e2e-lifecycle-model-8d2ddf84-kserve-self-signed-certs\""
Sep 11 18:38:03.254021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.253879    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8d2ddf84\"/\"default-dockercfg-nbndw\""
Sep 11 18:38:03.254212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.254194    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8d2ddf84\"/\"kube-root-ca.crt\""
Sep 11 18:38:03.254313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.254240    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8d2ddf84\"/\"openshift-service-ca.crt\""
Sep 11 18:38:03.261790 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.261769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"]
Sep 11 18:38:03.282447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.282418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:03.344872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.344841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-tmp-dir\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.345041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.344880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-home\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.345041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.345015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txsks\" (UniqueName: \"kubernetes.io/projected/db680734-1564-40ae-b3b3-9d0a8243d2a0-kube-api-access-txsks\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.345171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.345060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-model-cache\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.345171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.345133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db680734-1564-40ae-b3b3-9d0a8243d2a0-tls-certs\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.345171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.345161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-dshm\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.445963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-tmp-dir\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-home\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txsks\" (UniqueName: \"kubernetes.io/projected/db680734-1564-40ae-b3b3-9d0a8243d2a0-kube-api-access-txsks\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-model-cache\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db680734-1564-40ae-b3b3-9d0a8243d2a0-tls-certs\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446292 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446202    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-dshm\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446522    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-tmp-dir\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-home\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.446633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.446559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-model-cache\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.448515 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.448488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-dshm\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.448694 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.448677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db680734-1564-40ae-b3b3-9d0a8243d2a0-tls-certs\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.454153 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.454133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txsks\" (UniqueName: \"kubernetes.io/projected/db680734-1564-40ae-b3b3-9d0a8243d2a0-kube-api-access-txsks\") pod \"e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") " pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.559723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.559677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:03.849006 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:03.848973    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"]
Sep 11 18:38:03.850577 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:38:03.850550    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb680734_1564_40ae_b3b3_9d0a8243d2a0.slice/crio-2eac63e749b75ff936dbdcccdbba27db9eaf69a6c6d0ce6b4be05418bbca58f4 WatchSource:0}: Error finding container 2eac63e749b75ff936dbdcccdbba27db9eaf69a6c6d0ce6b4be05418bbca58f4: Status 404 returned error can't find the container with id 2eac63e749b75ff936dbdcccdbba27db9eaf69a6c6d0ce6b4be05418bbca58f4
Sep 11 18:38:04.205875 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:04.205776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm" event={"ID":"db680734-1564-40ae-b3b3-9d0a8243d2a0","Type":"ContainerStarted","Data":"4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3"}
Sep 11 18:38:04.205875 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:04.205829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm" event={"ID":"db680734-1564-40ae-b3b3-9d0a8243d2a0","Type":"ContainerStarted","Data":"2eac63e749b75ff936dbdcccdbba27db9eaf69a6c6d0ce6b4be05418bbca58f4"}
Sep 11 18:38:04.222727 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:04.222671    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm" podStartSLOduration=1.222656396 podStartE2EDuration="1.222656396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:38:04.221451454 +0000 UTC m=+1326.796554924" watchObservedRunningTime="2026-09-11 18:38:04.222656396 +0000 UTC m=+1326.797759862"
Sep 11 18:38:04.842484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:04.842450    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:04.943580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:04.943544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:05.031178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.031140    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"]
Sep 11 18:38:05.033214 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.033179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:05.034873 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.034848    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d18cc-btf55"]
Sep 11 18:38:05.098523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.098440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:05.395493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.395407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:05.498775 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.498736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:05.919293 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:05.919254    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c337abc5-ef6e-4e1a-ab54-5643fac1ee0e" path="/var/lib/kubelet/pods/c337abc5-ef6e-4e1a-ab54-5643fac1ee0e/volumes"
Sep 11 18:38:06.126977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:06.126913    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:07.027608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:07.027565    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:07.881188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:07.881153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:08.616023 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:08.615984    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:09.446272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:09.446235    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:11.702838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:11.702785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:11.775857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:11.775818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:11.990088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:11.989994    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:12.591024 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:12.590993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:12.901551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:12.901476    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"]
Sep 11 18:38:12.905574 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:12.905555    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:12.909068 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:12.909048    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w4-ec9107-openshift-default-dockercfg-kc6sf\""
Sep 11 18:38:12.920778 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:12.920748    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"]
Sep 11 18:38:12.935124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:12.935094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:13.053677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-credential-socket\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.053882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-token\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.053882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-certs\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.053882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istiod-ca-cert\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.054030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-data\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.054030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-socket\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.054030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rh8x\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-kube-api-access-6rh8x\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.054030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.053991    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-envoy\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.054030 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.054010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-podinfo\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-data\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-socket\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rh8x\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-kube-api-access-6rh8x\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-envoy\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-podinfo\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-credential-socket\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-token\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155887 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-certs\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155887 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istiod-ca-cert\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155887 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-data\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.155887 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.155788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-socket\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.156099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.156057    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-certs\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.156158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.156115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-credential-socket\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.156612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.156587    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istiod-ca-cert\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.158352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.158331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-envoy\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.158503 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.158484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-podinfo\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.172492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.172464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rh8x\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-kube-api-access-6rh8x\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.189961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.189919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-token\") pod \"e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") " pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.217407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.217351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:13.269287 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.269247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:13.508238 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:38:13.508208    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe37e57_b6e1_4b9c_a6e5_668a3b47ced8.slice/crio-908b946035f7dbcbd47d7abf357554f489541a0df5893c9659e0181bfa1bd9d7 WatchSource:0}: Error finding container 908b946035f7dbcbd47d7abf357554f489541a0df5893c9659e0181bfa1bd9d7: Status 404 returned error can't find the container with id 908b946035f7dbcbd47d7abf357554f489541a0df5893c9659e0181bfa1bd9d7
Sep 11 18:38:13.508655 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.508634    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"]
Sep 11 18:38:13.510493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.510459    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:13.510605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.510542    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:13.510605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.510586    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:13.560021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.559999    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:13.560143 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.560038    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:13.573784 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:13.573758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:14.279113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:14.279070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" event={"ID":"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8","Type":"ContainerStarted","Data":"3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"}
Sep 11 18:38:14.279667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:14.279136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" event={"ID":"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8","Type":"ContainerStarted","Data":"908b946035f7dbcbd47d7abf357554f489541a0df5893c9659e0181bfa1bd9d7"}
Sep 11 18:38:14.290806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:14.290780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:38:14.303497 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:14.303453    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podStartSLOduration=2.303437732 podStartE2EDuration="2.303437732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:38:14.299481413 +0000 UTC m=+1336.874584904" watchObservedRunningTime="2026-09-11 18:38:14.303437732 +0000 UTC m=+1336.878541200"
Sep 11 18:38:15.217559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:15.217525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:15.222857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:15.222830    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:15.291639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:15.291608    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:15.292709 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:15.292687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:15.655211 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:15.655178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:16.340261 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:16.340208    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:16.510380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:16.510336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:17.388641 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:17.388600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:18.165778 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:18.165742    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:19.056373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:19.056336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:19.760564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:19.760529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:20.640352 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:20.640288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:20.739376 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:20.739338    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:20.839463 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:20.839429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:21.121942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:21.121899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:21.205002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:21.204959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:24.523388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:24.523352    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:43.046183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:43.046148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:43.957586 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:43.957494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:44.769100 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:44.769044    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:45.521163 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:45.521125    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:46.398017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:46.397977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:46.498045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:46.498011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:46.737408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:46.737320    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:47.090979 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.090948    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"]
Sep 11 18:38:47.095258 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.095233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.099052 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.099034    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w4-d6c4cc-openshift-default-dockercfg-6tsmf\""
Sep 11 18:38:47.116967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.116940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"]
Sep 11 18:38:47.136254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.136222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:47.257365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.257325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63a909e-187a-4406-93f7-6fc8bd840000-istiod-ca-cert\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.257746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.257709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63a909e-187a-4406-93f7-6fc8bd840000-istio-podinfo\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.257974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.257956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d57fr\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-kube-api-access-d57fr\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.258125 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.258109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-istio-token\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.258287 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.258264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-socket\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.258454 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.258436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-credential-socket\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.258628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.258602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-data\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.258765 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.258750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-envoy\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.258894 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.258879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-certs\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63a909e-187a-4406-93f7-6fc8bd840000-istio-podinfo\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d57fr\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-kube-api-access-d57fr\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-istio-token\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-socket\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-credential-socket\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-data\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-envoy\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-certs\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.360737 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.360488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63a909e-187a-4406-93f7-6fc8bd840000-istiod-ca-cert\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.361426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.361399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63a909e-187a-4406-93f7-6fc8bd840000-istiod-ca-cert\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.362313 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.362255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-data\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.362994 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.362948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-certs\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.363412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.363395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-socket\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.363785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.363768    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-credential-socket\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.365039 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.365023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-envoy\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.373451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.373427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63a909e-187a-4406-93f7-6fc8bd840000-istio-podinfo\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.381099 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.381071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-istio-token\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.381578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.381553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d57fr\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-kube-api-access-d57fr\") pod \"e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") " pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.406198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.406175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:47.416561 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.416538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:47.575561 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.575529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:47.722844 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:38:47.722810    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63a909e_187a_4406_93f7_6fc8bd840000.slice/crio-8745ba075de9c88834308b2689a079f73258d5bfb7160326774d61c332059b30 WatchSource:0}: Error finding container 8745ba075de9c88834308b2689a079f73258d5bfb7160326774d61c332059b30: Status 404 returned error can't find the container with id 8745ba075de9c88834308b2689a079f73258d5bfb7160326774d61c332059b30
Sep 11 18:38:47.725188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.725165    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"]
Sep 11 18:38:47.725277 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.725192    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:47.725356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.725273    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:47.725356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:47.725346    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:48.535096 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:48.535061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" event={"ID":"e63a909e-187a-4406-93f7-6fc8bd840000","Type":"ContainerStarted","Data":"99d68ad75805a9a07bd5eea2c8dcf0c78d91df684a765d14ac1ed20561d7add2"}
Sep 11 18:38:48.535499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:48.535138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" event={"ID":"e63a909e-187a-4406-93f7-6fc8bd840000","Type":"ContainerStarted","Data":"8745ba075de9c88834308b2689a079f73258d5bfb7160326774d61c332059b30"}
Sep 11 18:38:48.568552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:48.568494    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podStartSLOduration=1.568474465 podStartE2EDuration="1.568474465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:38:48.568366398 +0000 UTC m=+1371.143469865" watchObservedRunningTime="2026-09-11 18:38:48.568474465 +0000 UTC m=+1371.143577932"
Sep 11 18:38:48.574229 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:48.574190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:49.406393 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:49.406349    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:49.412584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:49.412555    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:49.542515 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:49.542475    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:49.543948 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:49.543921    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:38:50.339444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:50.339407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:50.493856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:50.493817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:50.591825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:50.591745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:51.475537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:51.475500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:52.229565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.229529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:52.563850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.563811    2561 generic.go:356] "Generic (PLEG): container finished" podID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerID="3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4" exitCode=0
Sep 11 18:38:52.564018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.563894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" event={"ID":"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8","Type":"ContainerDied","Data":"3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"}
Sep 11 18:38:52.564423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.564402    2561 scope.go:117] "RemoveContainer" containerID="3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"
Sep 11 18:38:52.565626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.565597    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:52.565706 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.565687    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:52.565744 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:52.565719    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:38:53.171224 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:53.171187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:53.573779 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:53.573744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" event={"ID":"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8","Type":"ContainerStarted","Data":"a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888"}
Sep 11 18:38:53.888046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:53.887961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:54.217792 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:54.217705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:38:54.217961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:54.217939    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 11 18:38:54.218011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:54.217991    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 11 18:38:54.768015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:54.767977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:55.218461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:55.218368    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 11 18:38:55.218461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:55.218430    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 11 18:38:55.574187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:55.574148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:55.669866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:55.669826    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:55.768884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:55.768850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:56.080996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:56.080961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:56.184442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:56.184414    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:38:56.217738 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:56.217703    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 11 18:38:56.217890 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:56.217758    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 11 18:38:57.218514 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:57.218476    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 11 18:38:57.218882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:57.218552    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 11 18:38:58.153835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:58.153791    2561 scope.go:117] "RemoveContainer" containerID="6fa98d37ecee2750d0f92cd7bd4ccfe12f86efb7ce35ea8223af1c7113dbe56b"
Sep 11 18:38:58.218272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:58.218239    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 11 18:38:58.218437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:58.218325    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 11 18:38:59.218048 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:59.218011    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 11 18:38:59.218451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:38:59.218070    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 11 18:39:00.222424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:00.222394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:39:00.222806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:00.222688    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:39:00.223339 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:00.223296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:39:17.970812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:17.970767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:19.117951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:19.117914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:20.558269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:20.558226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:20.719790 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:20.719760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:22.048927 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:22.048876    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:23.238942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:23.238903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:24.627418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:24.627385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:25.816324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:25.816270    2561 generic.go:356] "Generic (PLEG): container finished" podID="e63a909e-187a-4406-93f7-6fc8bd840000" containerID="99d68ad75805a9a07bd5eea2c8dcf0c78d91df684a765d14ac1ed20561d7add2" exitCode=0
Sep 11 18:39:25.816726 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:25.816323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" event={"ID":"e63a909e-187a-4406-93f7-6fc8bd840000","Type":"ContainerDied","Data":"99d68ad75805a9a07bd5eea2c8dcf0c78d91df684a765d14ac1ed20561d7add2"}
Sep 11 18:39:25.816781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:25.816723    2561 scope.go:117] "RemoveContainer" containerID="99d68ad75805a9a07bd5eea2c8dcf0c78d91df684a765d14ac1ed20561d7add2"
Sep 11 18:39:25.818026 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:25.817997    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:39:25.818094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:25.818063    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:39:25.818134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:25.818098    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:39:26.019700 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:26.019664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:26.825377 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:26.825346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" event={"ID":"e63a909e-187a-4406-93f7-6fc8bd840000","Type":"ContainerStarted","Data":"a22d5b17af4bac9aa7c770fcaefd980a250f055bbf4d108d517bb2cd0bc60ab1"}
Sep 11 18:39:27.407135 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:27.407091    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:39:27.407374 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:27.407341    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 11 18:39:27.407467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:27.407402    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 11 18:39:27.887863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:27.887830    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:28.406693 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:28.406653    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 11 18:39:28.406930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:28.406909    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 11 18:39:29.406640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:29.406609    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 11 18:39:29.407035 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:29.407001    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 11 18:39:29.420114 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:29.420083    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"]
Sep 11 18:39:29.428212 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:29.428189    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:30.075328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:30.074576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:30.406989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:30.406901    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 11 18:39:30.406989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:30.406961    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 11 18:39:31.406688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:31.406654    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 11 18:39:31.406933 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:31.406910    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 11 18:39:32.411075 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:32.411036    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:39:32.411459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:32.411338    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:39:32.412113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:32.412097    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:39:36.161518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.161485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:36.647194 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.647156    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"]
Sep 11 18:39:36.651058 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.651031    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:36.656776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.656744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"]
Sep 11 18:39:36.673400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.673379    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:39:36.724608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.724574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0946485-2985-40e6-b8a1-57fb0d23e390-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg\" (UID: \"f0946485-2985-40e6-b8a1-57fb0d23e390\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:36.825669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.825635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0946485-2985-40e6-b8a1-57fb0d23e390-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg\" (UID: \"f0946485-2985-40e6-b8a1-57fb0d23e390\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:36.826282 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.826260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0946485-2985-40e6-b8a1-57fb0d23e390-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg\" (UID: \"f0946485-2985-40e6-b8a1-57fb0d23e390\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:36.964657 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:36.964576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:37.030434 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:37.030402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:37.246118 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:39:37.246077    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0946485_2985_40e6_b8a1_57fb0d23e390.slice/crio-b64f84caf1599980870bf4897701455df495fcd56c044c92e70bffe6c7434719 WatchSource:0}: Error finding container b64f84caf1599980870bf4897701455df495fcd56c044c92e70bffe6c7434719: Status 404 returned error can't find the container with id b64f84caf1599980870bf4897701455df495fcd56c044c92e70bffe6c7434719
Sep 11 18:39:37.249854 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:37.249830    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"]
Sep 11 18:39:37.920677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:37.920580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg" event={"ID":"f0946485-2985-40e6-b8a1-57fb0d23e390","Type":"ContainerStarted","Data":"55179012283d4a3b213fd9d943bfeeca2f750188175a75a6d1ae9e836096e151"}
Sep 11 18:39:37.920677 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:37.920642    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg" event={"ID":"f0946485-2985-40e6-b8a1-57fb0d23e390","Type":"ContainerStarted","Data":"b64f84caf1599980870bf4897701455df495fcd56c044c92e70bffe6c7434719"}
Sep 11 18:39:37.958743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:37.958700    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg" podStartSLOduration=1.958686627 podStartE2EDuration="1.958686627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:39:37.958220211 +0000 UTC m=+1420.533323676" watchObservedRunningTime="2026-09-11 18:39:37.958686627 +0000 UTC m=+1420.533790094"
Sep 11 18:39:38.711100 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:38.711065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:38.929479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:38.929444    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0946485-2985-40e6-b8a1-57fb0d23e390" containerID="55179012283d4a3b213fd9d943bfeeca2f750188175a75a6d1ae9e836096e151" exitCode=0
Sep 11 18:39:38.929644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:38.929531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg" event={"ID":"f0946485-2985-40e6-b8a1-57fb0d23e390","Type":"ContainerDied","Data":"55179012283d4a3b213fd9d943bfeeca2f750188175a75a6d1ae9e836096e151"}
Sep 11 18:39:40.078024 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.078000    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:40.157773 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.157738    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0946485-2985-40e6-b8a1-57fb0d23e390-maas-api-service-ca\") pod \"f0946485-2985-40e6-b8a1-57fb0d23e390\" (UID: \"f0946485-2985-40e6-b8a1-57fb0d23e390\") "
Sep 11 18:39:40.158119 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.158095    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0946485-2985-40e6-b8a1-57fb0d23e390-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0946485-2985-40e6-b8a1-57fb0d23e390" (UID: "f0946485-2985-40e6-b8a1-57fb0d23e390"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:39:40.158358 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.158340    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0946485-2985-40e6-b8a1-57fb0d23e390-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:40.562722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.562691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:40.943023 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.942946    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"
Sep 11 18:39:40.943023 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.942991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg" event={"ID":"f0946485-2985-40e6-b8a1-57fb0d23e390","Type":"ContainerDied","Data":"b64f84caf1599980870bf4897701455df495fcd56c044c92e70bffe6c7434719"}
Sep 11 18:39:40.943219 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:40.943037    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b64f84caf1599980870bf4897701455df495fcd56c044c92e70bffe6c7434719"
Sep 11 18:39:41.919895 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:41.919862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:43.295994 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:43.295961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:44.442612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.442550    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7" podUID="7ef1463a-c78a-4057-95a7-897dd6984237" containerName="main" containerID="cri-o://d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de" gracePeriod=45
Sep 11 18:39:44.707036 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.706970    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:39:44.806687 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806658    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-tmp-dir\") pod \"7ef1463a-c78a-4057-95a7-897dd6984237\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") "
Sep 11 18:39:44.806856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-dshm\") pod \"7ef1463a-c78a-4057-95a7-897dd6984237\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") "
Sep 11 18:39:44.806856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806758    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwjmr\" (UniqueName: \"kubernetes.io/projected/7ef1463a-c78a-4057-95a7-897dd6984237-kube-api-access-jwjmr\") pod \"7ef1463a-c78a-4057-95a7-897dd6984237\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") "
Sep 11 18:39:44.806856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806828    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-home\") pod \"7ef1463a-c78a-4057-95a7-897dd6984237\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") "
Sep 11 18:39:44.806856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806856    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef1463a-c78a-4057-95a7-897dd6984237-tls-certs\") pod \"7ef1463a-c78a-4057-95a7-897dd6984237\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") "
Sep 11 18:39:44.807076 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-model-cache\") pod \"7ef1463a-c78a-4057-95a7-897dd6984237\" (UID: \"7ef1463a-c78a-4057-95a7-897dd6984237\") "
Sep 11 18:39:44.807076 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.806954    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ef1463a-c78a-4057-95a7-897dd6984237" (UID: "7ef1463a-c78a-4057-95a7-897dd6984237"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:39:44.807176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.807089    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-home" (OuterVolumeSpecName: "home") pod "7ef1463a-c78a-4057-95a7-897dd6984237" (UID: "7ef1463a-c78a-4057-95a7-897dd6984237"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:39:44.807237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.807168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ef1463a-c78a-4057-95a7-897dd6984237" (UID: "7ef1463a-c78a-4057-95a7-897dd6984237"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:39:44.807326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.807291    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:44.807380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.807336    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:44.807380 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.807351    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:44.809013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.808964    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef1463a-c78a-4057-95a7-897dd6984237-kube-api-access-jwjmr" (OuterVolumeSpecName: "kube-api-access-jwjmr") pod "7ef1463a-c78a-4057-95a7-897dd6984237" (UID: "7ef1463a-c78a-4057-95a7-897dd6984237"). InnerVolumeSpecName "kube-api-access-jwjmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:39:44.809115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.809029    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-dshm" (OuterVolumeSpecName: "dshm") pod "7ef1463a-c78a-4057-95a7-897dd6984237" (UID: "7ef1463a-c78a-4057-95a7-897dd6984237"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:39:44.809115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.809045    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ef1463a-c78a-4057-95a7-897dd6984237-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ef1463a-c78a-4057-95a7-897dd6984237" (UID: "7ef1463a-c78a-4057-95a7-897dd6984237"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:39:44.908159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.908133    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwjmr\" (UniqueName: \"kubernetes.io/projected/7ef1463a-c78a-4057-95a7-897dd6984237-kube-api-access-jwjmr\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:44.908159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.908156    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef1463a-c78a-4057-95a7-897dd6984237-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:44.908159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.908165    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef1463a-c78a-4057-95a7-897dd6984237-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:39:44.970960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.970893    2561 generic.go:356] "Generic (PLEG): container finished" podID="7ef1463a-c78a-4057-95a7-897dd6984237" containerID="d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de" exitCode=0
Sep 11 18:39:44.970960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.970938    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"
Sep 11 18:39:44.971091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.970975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7" event={"ID":"7ef1463a-c78a-4057-95a7-897dd6984237","Type":"ContainerDied","Data":"d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de"}
Sep 11 18:39:44.971091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.971019    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7" event={"ID":"7ef1463a-c78a-4057-95a7-897dd6984237","Type":"ContainerDied","Data":"d2fe173dca8fc12549f94555de67c68a67ad7425c977068d14e41e29d5ca7a31"}
Sep 11 18:39:44.971091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.971038    2561 scope.go:117] "RemoveContainer" containerID="d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de"
Sep 11 18:39:44.982077 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.982060    2561 scope.go:117] "RemoveContainer" containerID="d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de"
Sep 11 18:39:44.982369 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:39:44.982353    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de\": container with ID starting with d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de not found: ID does not exist" containerID="d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de"
Sep 11 18:39:44.982423 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:44.982377    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de"} err="failed to get container status \"d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de\": rpc error: code = NotFound desc = could not find container \"d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de\": container with ID starting with d4a5862c235b65b715f11002e914bc5f774c3e832ec546b1f6e6ab08540b25de not found: ID does not exist"
Sep 11 18:39:45.015985 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:45.015962    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"]
Sep 11 18:39:45.027453 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:45.027432    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-c8b274/e2e-conflict-b-fbdeb325-kserve-76f9dbfbb4-wk6f7"]
Sep 11 18:39:45.534839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:45.534801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:45.909084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:45.909008    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef1463a-c78a-4057-95a7-897dd6984237" path="/var/lib/kubelet/pods/7ef1463a-c78a-4057-95a7-897dd6984237/volumes"
Sep 11 18:39:47.237507 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:47.237471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:48.787627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:48.787589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:51.977233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:51.977137    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:53.267282 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:53.267243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:53.329006 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:53.328946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:54.810683 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:54.810647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:54.911638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:54.911590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:55.013046 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:55.013015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:55.316920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:55.316878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:55.391027 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:55.390986    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:55.393602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:55.393574    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"]
Sep 11 18:39:55.401825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:55.401805    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d2ddf84-prstg"]
Sep 11 18:39:55.909446 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:55.909405    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0946485-2985-40e6-b8a1-57fb0d23e390" path="/var/lib/kubelet/pods/f0946485-2985-40e6-b8a1-57fb0d23e390/volumes"
Sep 11 18:39:56.098603 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:56.098563    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:57.449823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:57.449780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:57.942427 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:57.942393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:58.526960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:58.526930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:39:58.669172 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:39:58.669139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:00.196445 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:00.196407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:01.426637 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:01.426602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:02.725797 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:02.725758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:03.515769 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:03.515734    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"]
Sep 11 18:40:03.557626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:03.557599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:04.410973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:04.410934    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:18.535833 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.535791    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm" podUID="db680734-1564-40ae-b3b3-9d0a8243d2a0" containerName="main" containerID="cri-o://4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3" gracePeriod=45
Sep 11 18:40:18.793107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.793050    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:40:18.880523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880495    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-dshm\") pod \"db680734-1564-40ae-b3b3-9d0a8243d2a0\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") "
Sep 11 18:40:18.880675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880538    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-model-cache\") pod \"db680734-1564-40ae-b3b3-9d0a8243d2a0\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") "
Sep 11 18:40:18.880675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880594    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-home\") pod \"db680734-1564-40ae-b3b3-9d0a8243d2a0\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") "
Sep 11 18:40:18.880675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880649    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db680734-1564-40ae-b3b3-9d0a8243d2a0-tls-certs\") pod \"db680734-1564-40ae-b3b3-9d0a8243d2a0\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") "
Sep 11 18:40:18.880818 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880697    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-tmp-dir\") pod \"db680734-1564-40ae-b3b3-9d0a8243d2a0\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") "
Sep 11 18:40:18.880818 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880729    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txsks\" (UniqueName: \"kubernetes.io/projected/db680734-1564-40ae-b3b3-9d0a8243d2a0-kube-api-access-txsks\") pod \"db680734-1564-40ae-b3b3-9d0a8243d2a0\" (UID: \"db680734-1564-40ae-b3b3-9d0a8243d2a0\") "
Sep 11 18:40:18.880940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880868    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-home" (OuterVolumeSpecName: "home") pod "db680734-1564-40ae-b3b3-9d0a8243d2a0" (UID: "db680734-1564-40ae-b3b3-9d0a8243d2a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:40:18.880940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.880923    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "db680734-1564-40ae-b3b3-9d0a8243d2a0" (UID: "db680734-1564-40ae-b3b3-9d0a8243d2a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:40:18.881064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.881031    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db680734-1564-40ae-b3b3-9d0a8243d2a0" (UID: "db680734-1564-40ae-b3b3-9d0a8243d2a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:40:18.881243 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.881211    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:40:18.881404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.881248    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:40:18.881404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.881265    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:40:18.882751 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.882729    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-dshm" (OuterVolumeSpecName: "dshm") pod "db680734-1564-40ae-b3b3-9d0a8243d2a0" (UID: "db680734-1564-40ae-b3b3-9d0a8243d2a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:40:18.882924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.882906    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db680734-1564-40ae-b3b3-9d0a8243d2a0-kube-api-access-txsks" (OuterVolumeSpecName: "kube-api-access-txsks") pod "db680734-1564-40ae-b3b3-9d0a8243d2a0" (UID: "db680734-1564-40ae-b3b3-9d0a8243d2a0"). InnerVolumeSpecName "kube-api-access-txsks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:40:18.883042 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.883023    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db680734-1564-40ae-b3b3-9d0a8243d2a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db680734-1564-40ae-b3b3-9d0a8243d2a0" (UID: "db680734-1564-40ae-b3b3-9d0a8243d2a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:40:18.982256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.982217    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db680734-1564-40ae-b3b3-9d0a8243d2a0-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:40:18.982256 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.982251    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db680734-1564-40ae-b3b3-9d0a8243d2a0-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:40:18.982504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:18.982267    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txsks\" (UniqueName: \"kubernetes.io/projected/db680734-1564-40ae-b3b3-9d0a8243d2a0-kube-api-access-txsks\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:40:19.209228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.209142    2561 generic.go:356] "Generic (PLEG): container finished" podID="db680734-1564-40ae-b3b3-9d0a8243d2a0" containerID="4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3" exitCode=0
Sep 11 18:40:19.209228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.209184    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"
Sep 11 18:40:19.209489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.209225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm" event={"ID":"db680734-1564-40ae-b3b3-9d0a8243d2a0","Type":"ContainerDied","Data":"4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3"}
Sep 11 18:40:19.209489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.209267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm" event={"ID":"db680734-1564-40ae-b3b3-9d0a8243d2a0","Type":"ContainerDied","Data":"2eac63e749b75ff936dbdcccdbba27db9eaf69a6c6d0ce6b4be05418bbca58f4"}
Sep 11 18:40:19.209489 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.209283    2561 scope.go:117] "RemoveContainer" containerID="4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3"
Sep 11 18:40:19.220192 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.220174    2561 scope.go:117] "RemoveContainer" containerID="4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3"
Sep 11 18:40:19.220483 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:40:19.220466    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3\": container with ID starting with 4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3 not found: ID does not exist" containerID="4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3"
Sep 11 18:40:19.220537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.220491    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3"} err="failed to get container status \"4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3\": rpc error: code = NotFound desc = could not find container \"4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3\": container with ID starting with 4bbf4a772bba204f980d5d142f2dd8c1ca29a65b04ef9294f5a37d7b4a625cc3 not found: ID does not exist"
Sep 11 18:40:19.276593 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.276562    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"]
Sep 11 18:40:19.285161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.285138    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8d2ddf84/e2e-lifecycle-model-8d2ddf84-kserve-6bcd76f79f-lg8rm"]
Sep 11 18:40:19.909057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:19.909023    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db680734-1564-40ae-b3b3-9d0a8243d2a0" path="/var/lib/kubelet/pods/db680734-1564-40ae-b3b3-9d0a8243d2a0/volumes"
Sep 11 18:40:22.060071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:22.060038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:33.696934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:33.696897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.423509    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"]
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.424733    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef1463a-c78a-4057-95a7-897dd6984237" containerName="main"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.424758    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef1463a-c78a-4057-95a7-897dd6984237" containerName="main"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.424802    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0946485-2985-40e6-b8a1-57fb0d23e390" containerName="revoke-keys"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.424811    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0946485-2985-40e6-b8a1-57fb0d23e390" containerName="revoke-keys"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.424870    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db680734-1564-40ae-b3b3-9d0a8243d2a0" containerName="main"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.424888    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="db680734-1564-40ae-b3b3-9d0a8243d2a0" containerName="main"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.425113    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0946485-2985-40e6-b8a1-57fb0d23e390" containerName="revoke-keys"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.425138    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef1463a-c78a-4057-95a7-897dd6984237" containerName="main"
Sep 11 18:40:34.425348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.425164    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="db680734-1564-40ae-b3b3-9d0a8243d2a0" containerName="main"
Sep 11 18:40:34.430736 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.430701    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.433995 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.433969    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"]
Sep 11 18:40:34.443240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.443215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-home\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.443391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.443248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-dshm\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.443391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.443334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-model-cache\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.443543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.443407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-tmp-dir\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.443543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.443431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ed75c3-7982-46ec-9440-57daa12f9f6e-tls-certs\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.443678 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.443557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b929j\" (UniqueName: \"kubernetes.io/projected/70ed75c3-7982-46ec-9440-57daa12f9f6e-kube-api-access-b929j\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.452418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.452387    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:34.457723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.457675    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w4-d6c4cc\"/\"default-dockercfg-wgdr8\""
Sep 11 18:40:34.457723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.457718    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w4-d6c4cc\"/\"auth-test-model-d6c4cc-kserve-self-signed-certs\""
Sep 11 18:40:34.457920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.457695    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w4-d6c4cc\"/\"openshift-service-ca.crt\""
Sep 11 18:40:34.457920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.457677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w4-d6c4cc\"/\"kube-root-ca.crt\""
Sep 11 18:40:34.544332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b929j\" (UniqueName: \"kubernetes.io/projected/70ed75c3-7982-46ec-9440-57daa12f9f6e-kube-api-access-b929j\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-home\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-dshm\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-model-cache\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-tmp-dir\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ed75c3-7982-46ec-9440-57daa12f9f6e-tls-certs\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544863 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544839    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-home\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544923 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-model-cache\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.544962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.544946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-tmp-dir\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.546755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.546732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-dshm\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.547019 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.547003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ed75c3-7982-46ec-9440-57daa12f9f6e-tls-certs\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.564776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.564746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b929j\" (UniqueName: \"kubernetes.io/projected/70ed75c3-7982-46ec-9440-57daa12f9f6e-kube-api-access-b929j\") pod \"auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") " pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:34.745633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:34.745536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:35.023156 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:40:35.023123    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70ed75c3_7982_46ec_9440_57daa12f9f6e.slice/crio-c2b6bb3b0b0dbbf6db2c523e0385cfc7f140ef4b9b7acc996ceacf6b242f8f98 WatchSource:0}: Error finding container c2b6bb3b0b0dbbf6db2c523e0385cfc7f140ef4b9b7acc996ceacf6b242f8f98: Status 404 returned error can't find the container with id c2b6bb3b0b0dbbf6db2c523e0385cfc7f140ef4b9b7acc996ceacf6b242f8f98
Sep 11 18:40:35.032206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:35.032183    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"]
Sep 11 18:40:35.317944 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:35.317858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4" event={"ID":"70ed75c3-7982-46ec-9440-57daa12f9f6e","Type":"ContainerStarted","Data":"5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620"}
Sep 11 18:40:35.317944 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:35.317900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4" event={"ID":"70ed75c3-7982-46ec-9440-57daa12f9f6e","Type":"ContainerStarted","Data":"c2b6bb3b0b0dbbf6db2c523e0385cfc7f140ef4b9b7acc996ceacf6b242f8f98"}
Sep 11 18:40:35.378834 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:35.378782    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4" podStartSLOduration=1.378766457 podStartE2EDuration="1.378766457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:40:35.363536392 +0000 UTC m=+1477.938639859" watchObservedRunningTime="2026-09-11 18:40:35.378766457 +0000 UTC m=+1477.953869925"
Sep 11 18:40:40.140333 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:40.140279    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:40.582811 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:40.582778    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:44.453900 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:44.453853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:44.556332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:44.556278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:44.745822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:44.745723    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:44.745822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:44.745778    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:44.758558 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:44.758519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:45.395930 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:45.395901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:40:46.179376 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:46.179296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:49.463534 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:49.463500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:40:57.987877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:57.987850    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:40:57.990736 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:57.990716    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:40:58.203845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:40:58.203815    2561 scope.go:117] "RemoveContainer" containerID="7aef516f4528db8ff24bdc90cbf1ef8aa299dede3c2a005826764cba63a54a3e"
Sep 11 18:41:00.502216 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:00.502185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:00.600727 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:00.600698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:00.741959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:00.741925    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"]
Sep 11 18:41:00.742184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:00.742145    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy" containerID="cri-o://70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe" gracePeriod=30
Sep 11 18:41:00.753326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:00.753225    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:02.035023 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:02.034991    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:02.129593 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:02.129556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:02.226217 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:02.226180    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:02.829446 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:02.829408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:02.927168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:02.927118    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:02.993181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:02.993148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:03.076602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:03.076564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:04.302498 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:04.302462    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:04.511310 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:04.511260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:06.010346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.010266    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:41:06.080089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080057    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-podinfo\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080094    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-envoy\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-socket\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080194    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-token\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080233    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7tqk\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-kube-api-access-v7tqk\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080287    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-certs\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080355    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-credential-socket\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080452    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-data\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080493    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:41:06.080530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb596a17-fe25-4c21-a66d-2894c4c4a105-istiod-ca-cert\") pod \"cb596a17-fe25-4c21-a66d-2894c4c4a105\" (UID: \"cb596a17-fe25-4c21-a66d-2894c4c4a105\") "
Sep 11 18:41:06.080800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080641    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:41:06.080800 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080759    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:41:06.080922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080865    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:41:06.080922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.080902    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb596a17-fe25-4c21-a66d-2894c4c4a105-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:41:06.081124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.081107    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb596a17-fe25-4c21-a66d-2894c4c4a105-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.081190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.081130    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.081190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.081146    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.081190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.081159    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.081190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.081173    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.082424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.082399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:41:06.082560 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.082432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:41:06.082729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.082710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-kube-api-access-v7tqk" (OuterVolumeSpecName: "kube-api-access-v7tqk") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "kube-api-access-v7tqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:41:06.082793 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.082719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb596a17-fe25-4c21-a66d-2894c4c4a105" (UID: "cb596a17-fe25-4c21-a66d-2894c4c4a105"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:41:06.182263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.182234    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.182263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.182258    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.182263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.182267    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.182469 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.182276    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7tqk\" (UniqueName: \"kubernetes.io/projected/cb596a17-fe25-4c21-a66d-2894c4c4a105-kube-api-access-v7tqk\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:41:06.533991 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.533957    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerID="70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe" exitCode=0
Sep 11 18:41:06.534171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.534004    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"
Sep 11 18:41:06.534171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.534045    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" event={"ID":"cb596a17-fe25-4c21-a66d-2894c4c4a105","Type":"ContainerDied","Data":"70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe"}
Sep 11 18:41:06.534171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.534104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s" event={"ID":"cb596a17-fe25-4c21-a66d-2894c4c4a105","Type":"ContainerDied","Data":"e1bbd3fb046eb4e9bf0813be746e20388b4afeff644a67a4177c1bd519a0d859"}
Sep 11 18:41:06.534171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.534131    2561 scope.go:117] "RemoveContainer" containerID="70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe"
Sep 11 18:41:06.544610 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.544593    2561 scope.go:117] "RemoveContainer" containerID="6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"
Sep 11 18:41:06.553748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.553730    2561 scope.go:117] "RemoveContainer" containerID="70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe"
Sep 11 18:41:06.554034 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:41:06.554012    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe\": container with ID starting with 70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe not found: ID does not exist" containerID="70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe"
Sep 11 18:41:06.554114 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.554042    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe"} err="failed to get container status \"70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe\": rpc error: code = NotFound desc = could not find container \"70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe\": container with ID starting with 70a79b2ae61439e0b18101dd7395b373494afac951e7eef7b54edb92cc29edfe not found: ID does not exist"
Sep 11 18:41:06.554114 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.554061    2561 scope.go:117] "RemoveContainer" containerID="6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"
Sep 11 18:41:06.554353 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:41:06.554328    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394\": container with ID starting with 6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394 not found: ID does not exist" containerID="6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"
Sep 11 18:41:06.554483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.554353    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394"} err="failed to get container status \"6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394\": rpc error: code = NotFound desc = could not find container \"6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394\": container with ID starting with 6e871c01ad55c5701c0f862706c92e1dd46c39fb4d40d866daeef01d61595394 not found: ID does not exist"
Sep 11 18:41:06.770662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.770626    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"]
Sep 11 18:41:06.780511 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:06.780478    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s"]
Sep 11 18:41:07.908588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:07.908555    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" path="/var/lib/kubelet/pods/cb596a17-fe25-4c21-a66d-2894c4c4a105/volumes"
Sep 11 18:41:10.386254 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:10.386220    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:10.487518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:10.487477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:11.101713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:11.101662    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:16.893828 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:16.893789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:16.956587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:16.956549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:17.056906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:17.056857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:17.160252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:17.160138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:27.590987 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:27.590899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:27.804190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:27.804156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:37.457281 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:37.457245    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:43.063703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:43.063667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:48.670608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.670575    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"]
Sep 11 18:41:48.671129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.671105    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy"
Sep 11 18:41:48.671129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.671128    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy"
Sep 11 18:41:48.671458 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.671189    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy"
Sep 11 18:41:48.671458 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.671201    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy"
Sep 11 18:41:48.671458 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.671409    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy"
Sep 11 18:41:48.671458 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.671426    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb596a17-fe25-4c21-a66d-2894c4c4a105" containerName="istio-proxy"
Sep 11 18:41:48.674959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.674939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.680644 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.680615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b63ece\"/\"openshift-service-ca.crt\""
Sep 11 18:41:48.680846 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.680662    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b63ece\"/\"embedding-w0-b63ece-kserve-self-signed-certs\""
Sep 11 18:41:48.680960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.680659    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b63ece\"/\"kube-root-ca.crt\""
Sep 11 18:41:48.681011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.680752    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b63ece\"/\"default-dockercfg-nbccq\""
Sep 11 18:41:48.692844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.692815    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"]
Sep 11 18:41:48.717860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.717822    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:48.757845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.757805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0967ca80-a8b9-423a-be5f-4311e7e19417-tls-certs\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.757845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.757848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-tmp-dir\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.758059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.757976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-model-cache\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.758059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.758006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-dshm\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.758138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.758073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvzz9\" (UniqueName: \"kubernetes.io/projected/0967ca80-a8b9-423a-be5f-4311e7e19417-kube-api-access-rvzz9\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.758138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.758106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-home\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.784554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.784513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:48.859365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-model-cache\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859365 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-dshm\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvzz9\" (UniqueName: \"kubernetes.io/projected/0967ca80-a8b9-423a-be5f-4311e7e19417-kube-api-access-rvzz9\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-home\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0967ca80-a8b9-423a-be5f-4311e7e19417-tls-certs\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859639 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-tmp-dir\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859853 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-model-cache\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859853 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-home\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.859925 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.859863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-tmp-dir\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.861697 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.861675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-dshm\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.861983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.861965    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0967ca80-a8b9-423a-be5f-4311e7e19417-tls-certs\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.870646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.870622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvzz9\" (UniqueName: \"kubernetes.io/projected/0967ca80-a8b9-423a-be5f-4311e7e19417-kube-api-access-rvzz9\") pod \"embedding-w0-b63ece-kserve-5b4d86d64-lmg6z\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") " pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:48.985939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:48.985843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:49.264861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:49.264831    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"]
Sep 11 18:41:49.265747 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:41:49.265719    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0967ca80_a8b9_423a_be5f_4311e7e19417.slice/crio-8cddfcd2ac7791ec74e1ad1a96df1985b26f1187f9a71a928e2aaa7e38b5e913 WatchSource:0}: Error finding container 8cddfcd2ac7791ec74e1ad1a96df1985b26f1187f9a71a928e2aaa7e38b5e913: Status 404 returned error can't find the container with id 8cddfcd2ac7791ec74e1ad1a96df1985b26f1187f9a71a928e2aaa7e38b5e913
Sep 11 18:41:49.833601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:49.833564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z" event={"ID":"0967ca80-a8b9-423a-be5f-4311e7e19417","Type":"ContainerStarted","Data":"cb62c0a090bc4736f6a55c40bad2853cbd5b3da848fdfd1db3e6cc0b034fad19"}
Sep 11 18:41:49.833601 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:49.833604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z" event={"ID":"0967ca80-a8b9-423a-be5f-4311e7e19417","Type":"ContainerStarted","Data":"8cddfcd2ac7791ec74e1ad1a96df1985b26f1187f9a71a928e2aaa7e38b5e913"}
Sep 11 18:41:49.854320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:49.853202    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z" podStartSLOduration=1.85318155 podStartE2EDuration="1.85318155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:41:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:41:49.851203752 +0000 UTC m=+1552.426307221" watchObservedRunningTime="2026-09-11 18:41:49.85318155 +0000 UTC m=+1552.428285020"
Sep 11 18:41:54.742063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:54.742029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:54.842823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:54.842779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:55.087278 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.087245    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:55.385083 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.384998    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"]
Sep 11 18:41:55.389190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.389168    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.392133 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.392115    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6c4c23-openshift-default-dockercfg-wbjwx\""
Sep 11 18:41:55.404091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.404062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"]
Sep 11 18:41:55.413353 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.413285    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:55.534438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-credential-socket\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-token\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-podinfo\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-data\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-certs\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf74ece-addf-46ba-9cea-c912329e5b0b-istiod-ca-cert\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-envoy\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534770 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48n2t\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-kube-api-access-48n2t\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.534964 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.534779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-socket\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.635990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-certs\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf74ece-addf-46ba-9cea-c912329e5b0b-istiod-ca-cert\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-envoy\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48n2t\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-kube-api-access-48n2t\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-socket\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-credential-socket\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-token\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-podinfo\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-data\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636605 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-certs\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf74ece-addf-46ba-9cea-c912329e5b0b-istiod-ca-cert\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636893 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-socket\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636972 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636917    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-credential-socket\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.636972 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.636936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-data\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.638529 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.638507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-envoy\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.638822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.638802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-podinfo\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.646132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.646108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-token\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.646263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.646197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48n2t\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-kube-api-access-48n2t\") pod \"e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") " pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.703522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.703479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:55.704420 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.704398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:55.994733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.994697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"]
Sep 11 18:41:55.995832 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:41:55.995802    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf74ece_addf_46ba_9cea_c912329e5b0b.slice/crio-93818ff81ce7556454ca6644cae6987a86ad117ae80473b6813dcd3afdd5a460 WatchSource:0}: Error finding container 93818ff81ce7556454ca6644cae6987a86ad117ae80473b6813dcd3afdd5a460: Status 404 returned error can't find the container with id 93818ff81ce7556454ca6644cae6987a86ad117ae80473b6813dcd3afdd5a460
Sep 11 18:41:55.998646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.998608    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:41:55.998731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.998675    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:41:55.998731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:55.998704    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:41:56.880682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:56.880647    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" event={"ID":"ecf74ece-addf-46ba-9cea-c912329e5b0b","Type":"ContainerStarted","Data":"8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"}
Sep 11 18:41:56.880860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:56.880701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" event={"ID":"ecf74ece-addf-46ba-9cea-c912329e5b0b","Type":"ContainerStarted","Data":"93818ff81ce7556454ca6644cae6987a86ad117ae80473b6813dcd3afdd5a460"}
Sep 11 18:41:56.901463 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:56.901415    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podStartSLOduration=1.901400571 podStartE2EDuration="1.901400571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:41:56.899450774 +0000 UTC m=+1559.474554243" watchObservedRunningTime="2026-09-11 18:41:56.901400571 +0000 UTC m=+1559.476504040"
Sep 11 18:41:57.705454 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:57.705418    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:57.710806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:57.710782    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:57.888238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:57.888204    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:57.889029 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:57.889010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:41:58.148513 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:58.148472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:58.826487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:58.826454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:58.918739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:58.918678    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:58.986806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:58.986780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:58.986990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:58.986824    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:58.999022 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:58.999000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:59.236631 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:59.236549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:41:59.914956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:59.914927    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:41:59.962689 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:41:59.962636    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:00.854825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:00.854788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:01.537542 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:01.537501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:02.531838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:02.531801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:03.429331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:03.429278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:04.340718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:04.340676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:04.421714 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:04.421676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:04.805899 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:04.805866    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:04.891729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:04.891696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:04.971128 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:04.971097    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:08.039780 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:08.039746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:24.066407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:24.066375    2561 generic.go:356] "Generic (PLEG): container finished" podID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerID="8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b" exitCode=0
Sep 11 18:42:24.066926 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:24.066451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" event={"ID":"ecf74ece-addf-46ba-9cea-c912329e5b0b","Type":"ContainerDied","Data":"8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"}
Sep 11 18:42:24.066999 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:24.066937    2561 scope.go:117] "RemoveContainer" containerID="8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"
Sep 11 18:42:24.068168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:24.068127    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:42:24.068288 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:24.068243    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:42:24.068381 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:24.068291    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:42:25.076870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:25.076825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" event={"ID":"ecf74ece-addf-46ba-9cea-c912329e5b0b","Type":"ContainerStarted","Data":"d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440"}
Sep 11 18:42:25.705488 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:25.705450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:42:25.706919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:25.706885    2561 patch_prober.go:28] interesting pod/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Sep 11 18:42:25.707084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:25.706937    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Sep 11 18:42:26.024848 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:26.024812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:26.704942 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:26.704900    2561 patch_prober.go:28] interesting pod/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Sep 11 18:42:26.705393 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:26.704964    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Sep 11 18:42:26.859049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:26.859007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:27.671550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:27.671508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:27.705143 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:27.705106    2561 patch_prober.go:28] interesting pod/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Sep 11 18:42:27.705528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:27.705163    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Sep 11 18:42:27.888320 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:27.888281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:42:28.373170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:28.373133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:28.704839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:28.704750    2561 patch_prober.go:28] interesting pod/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Sep 11 18:42:28.704839 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:28.704812    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Sep 11 18:42:28.952071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:28.952033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:29.257134 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.257100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:29.419979 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.419943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:29.703102 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.703020    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"]
Sep 11 18:42:29.705627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.705593    2561 patch_prober.go:28] interesting pod/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Sep 11 18:42:29.705756 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.705670    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Sep 11 18:42:29.706132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.706117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.709250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.709231    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-999aa4-openshift-default-dockercfg-4sbl7\""
Sep 11 18:42:29.718288 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.718263    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"]
Sep 11 18:42:29.727439 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.727410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:29.727939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.727918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-data\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.727952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383d9c2f-c4d8-4097-9687-599544726d0d-istiod-ca-cert\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728028 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.727982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-credential-socket\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728121 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.728081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383d9c2f-c4d8-4097-9687-599544726d0d-istio-podinfo\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728176 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.728121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-certs\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728250 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.728235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-envoy\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728325 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.728273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr58n\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-kube-api-access-hr58n\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.728372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-istio-token\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.728447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.728426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-socket\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-istio-token\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-socket\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-data\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383d9c2f-c4d8-4097-9687-599544726d0d-istiod-ca-cert\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-credential-socket\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383d9c2f-c4d8-4097-9687-599544726d0d-istio-podinfo\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-certs\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-envoy\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.833835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr58n\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-kube-api-access-hr58n\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.834933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-socket\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.835195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-data\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.835924 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.835631    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-certs\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.837487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.837458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383d9c2f-c4d8-4097-9687-599544726d0d-istiod-ca-cert\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.838609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.838588    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-envoy\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.839193 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.839164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-credential-socket\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.840326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.840286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383d9c2f-c4d8-4097-9687-599544726d0d-istio-podinfo\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.843184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.843161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr58n\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-kube-api-access-hr58n\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:29.847786 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:29.847757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-istio-token\") pod \"e2e-api-b-999aa4-openshift-default-7756697448-krdx4\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") " pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:30.020251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.020214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:30.033738 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.033695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:30.312408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.312369    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"]
Sep 11 18:42:30.314073 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:42:30.314045    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383d9c2f_c4d8_4097_9687_599544726d0d.slice/crio-41622c95998326a57f16cedee3a4dd8d18d6798fb4a6a414e18b600e3ae311c3 WatchSource:0}: Error finding container 41622c95998326a57f16cedee3a4dd8d18d6798fb4a6a414e18b600e3ae311c3: Status 404 returned error can't find the container with id 41622c95998326a57f16cedee3a4dd8d18d6798fb4a6a414e18b600e3ae311c3
Sep 11 18:42:30.317041 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.317002    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:42:30.317148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.317090    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:42:30.317148 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.317142    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:42:30.368670 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.368633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:30.708672 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.708592    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:42:30.709604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.709580    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:42:30.937915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:30.937879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:31.124771 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:31.124729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" event={"ID":"383d9c2f-c4d8-4097-9687-599544726d0d","Type":"ContainerStarted","Data":"808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"}
Sep 11 18:42:31.125241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:31.124794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" event={"ID":"383d9c2f-c4d8-4097-9687-599544726d0d","Type":"ContainerStarted","Data":"41622c95998326a57f16cedee3a4dd8d18d6798fb4a6a414e18b600e3ae311c3"}
Sep 11 18:42:31.146933 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:31.146885    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podStartSLOduration=2.146871276 podStartE2EDuration="2.146871276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:42:31.145156184 +0000 UTC m=+1593.720259653" watchObservedRunningTime="2026-09-11 18:42:31.146871276 +0000 UTC m=+1593.721974744"
Sep 11 18:42:31.628483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:31.628435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:32.020821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:32.020784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:32.026356 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:32.026329    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:32.131602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:32.131572    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:32.132528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:32.132510    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:42:32.468609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:32.468513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:33.180806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:33.180777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:33.274085 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:33.274048    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:34.041056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:34.041021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:34.819842 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:34.819808    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:35.640496 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:35.640461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:36.331116 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:36.331083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:37.137337 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:37.137284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:37.858596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:37.858556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:38.566961 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:38.566928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:38.635706 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:38.635649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:38.736103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:38.736064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:39.253772 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:39.253722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:42:39.404916 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:42:39.404874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:00.291105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.291065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:00.397978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.397949    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"]
Sep 11 18:43:00.400894 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.400870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:00.403456 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.403437    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:43:00.409663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.409639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"]
Sep 11 18:43:00.502592 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.502560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e828388b-507b-438d-92be-644dc7e7cdd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8\" (UID: \"e828388b-507b-438d-92be-644dc7e7cdd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:00.603934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.603842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e828388b-507b-438d-92be-644dc7e7cdd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8\" (UID: \"e828388b-507b-438d-92be-644dc7e7cdd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:00.604498 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.604479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e828388b-507b-438d-92be-644dc7e7cdd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8\" (UID: \"e828388b-507b-438d-92be-644dc7e7cdd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:00.716381 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.716349    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:00.995042 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:43:00.995012    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode828388b_507b_438d_92be_644dc7e7cdd9.slice/crio-d06a48e5e34d22c241e09d3c7b61fca2f21ffbcb7587b844748ba2c61f58002f WatchSource:0}: Error finding container d06a48e5e34d22c241e09d3c7b61fca2f21ffbcb7587b844748ba2c61f58002f: Status 404 returned error can't find the container with id d06a48e5e34d22c241e09d3c7b61fca2f21ffbcb7587b844748ba2c61f58002f
Sep 11 18:43:00.995781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:00.995752    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"]
Sep 11 18:43:01.342158 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:01.342118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8" event={"ID":"e828388b-507b-438d-92be-644dc7e7cdd9","Type":"ContainerStarted","Data":"d06a48e5e34d22c241e09d3c7b61fca2f21ffbcb7587b844748ba2c61f58002f"}
Sep 11 18:43:01.596420 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:01.596339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:01.694880 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:01.694817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:02.130326 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.130212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:02.133198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.133174    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:02.133344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.133220    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:02.351432 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.351392    2561 generic.go:356] "Generic (PLEG): container finished" podID="e828388b-507b-438d-92be-644dc7e7cdd9" containerID="cc765719692d457a80a4aa8694129e8e3d709e3e867d057eaa8b9f14e3ffaffe" exitCode=0
Sep 11 18:43:02.351834 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.351477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8" event={"ID":"e828388b-507b-438d-92be-644dc7e7cdd9","Type":"ContainerDied","Data":"cc765719692d457a80a4aa8694129e8e3d709e3e867d057eaa8b9f14e3ffaffe"}
Sep 11 18:43:02.353165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.353144    2561 generic.go:356] "Generic (PLEG): container finished" podID="383d9c2f-c4d8-4097-9687-599544726d0d" containerID="808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e" exitCode=0
Sep 11 18:43:02.353266 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.353218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" event={"ID":"383d9c2f-c4d8-4097-9687-599544726d0d","Type":"ContainerDied","Data":"808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"}
Sep 11 18:43:02.353643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.353630    2561 scope.go:117] "RemoveContainer" containerID="808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"
Sep 11 18:43:02.354884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.354851    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:43:02.354985 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.354940    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:43:02.355032 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.355013    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:43:02.844579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:02.844542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:03.361854 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:03.361818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" event={"ID":"383d9c2f-c4d8-4097-9687-599544726d0d","Type":"ContainerStarted","Data":"a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4"}
Sep 11 18:43:03.499226 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:03.499200    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:03.656329 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:03.656184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e828388b-507b-438d-92be-644dc7e7cdd9-maas-api-service-ca\") pod \"e828388b-507b-438d-92be-644dc7e7cdd9\" (UID: \"e828388b-507b-438d-92be-644dc7e7cdd9\") "
Sep 11 18:43:03.657021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:03.656987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e828388b-507b-438d-92be-644dc7e7cdd9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e828388b-507b-438d-92be-644dc7e7cdd9" (UID: "e828388b-507b-438d-92be-644dc7e7cdd9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:43:03.751994 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:03.751833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:03.760325 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:03.760265    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e828388b-507b-438d-92be-644dc7e7cdd9-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:04.021267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.021229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:43:04.021490 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.021470    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:04.021564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.021513    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:04.373328 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.373272    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"
Sep 11 18:43:04.373750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.373282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8" event={"ID":"e828388b-507b-438d-92be-644dc7e7cdd9","Type":"ContainerDied","Data":"d06a48e5e34d22c241e09d3c7b61fca2f21ffbcb7587b844748ba2c61f58002f"}
Sep 11 18:43:04.373750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.373430    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d06a48e5e34d22c241e09d3c7b61fca2f21ffbcb7587b844748ba2c61f58002f"
Sep 11 18:43:04.547536 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:04.547499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:05.021394 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:05.021358    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:05.021590 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:05.021410    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:05.302589 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:05.302504    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"]
Sep 11 18:43:05.518171 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:05.518142    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:05.648049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:05.647946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:06.020588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:06.020552    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:06.020753 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:06.020610    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:06.652437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:06.652394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:07.020852 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:07.020815    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:07.021018 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:07.020868    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:07.609440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:07.609404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:08.020971 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:08.020939    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:08.021343 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:08.020992    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:08.482925 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:08.482835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:09.020693 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:09.020657    2561 patch_prober.go:28] interesting pod/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 11 18:43:09.020977 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:09.020943    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 11 18:43:09.412127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:09.412035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:10.025249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:10.025213    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:43:10.025521 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:10.025501    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:43:10.026241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:10.026222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:43:10.111842 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:10.111785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:10.818249 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:10.818210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:11.566169 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:11.566138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:12.456065 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:12.456016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:13.177251 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:13.177212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:13.356816 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:13.356781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:14.129069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:14.129034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:14.838002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:14.837958    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:15.668858 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:15.668821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:16.354412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.354377    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"]
Sep 11 18:43:16.355219 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.355199    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e828388b-507b-438d-92be-644dc7e7cdd9" containerName="revoke-keys"
Sep 11 18:43:16.355261 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.355225    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e828388b-507b-438d-92be-644dc7e7cdd9" containerName="revoke-keys"
Sep 11 18:43:16.355415 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.355402    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e828388b-507b-438d-92be-644dc7e7cdd9" containerName="revoke-keys"
Sep 11 18:43:16.358868 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.358838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:16.361702 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.361511    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:43:16.366919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.366892    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"]
Sep 11 18:43:16.399902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.399864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc\" (UID: \"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:16.500941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.500892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc\" (UID: \"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:16.501543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.501525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc\" (UID: \"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:16.677419 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.677339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:16.740502 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.740294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:16.951836 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:16.951807    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"]
Sep 11 18:43:16.953621 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:43:16.953600    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2f6617_adb4_4c0e_bcc6_b2dc5bb033e5.slice/crio-43901c028259418e4402cdb79c3a66264d2e5aa009f0b8bbd65270339f657bdd WatchSource:0}: Error finding container 43901c028259418e4402cdb79c3a66264d2e5aa009f0b8bbd65270339f657bdd: Status 404 returned error can't find the container with id 43901c028259418e4402cdb79c3a66264d2e5aa009f0b8bbd65270339f657bdd
Sep 11 18:43:17.475204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:17.475166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc" event={"ID":"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5","Type":"ContainerStarted","Data":"370cccb0425198250171ea76fbeeeaabe24ff9d464e9c1f5044dd2f14bd94ea8"}
Sep 11 18:43:17.475386 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:17.475223    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc" event={"ID":"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5","Type":"ContainerStarted","Data":"43901c028259418e4402cdb79c3a66264d2e5aa009f0b8bbd65270339f657bdd"}
Sep 11 18:43:17.493466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:17.493419    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc" podStartSLOduration=1.493404381 podStartE2EDuration="1.493404381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:43:17.490800776 +0000 UTC m=+1640.065904245" watchObservedRunningTime="2026-09-11 18:43:17.493404381 +0000 UTC m=+1640.068507870"
Sep 11 18:43:17.610669 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:17.610585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:18.227646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.227611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:18.329397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.329365    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:18.426208 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.426171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:18.484200 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.484122    2561 generic.go:356] "Generic (PLEG): container finished" podID="9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5" containerID="370cccb0425198250171ea76fbeeeaabe24ff9d464e9c1f5044dd2f14bd94ea8" exitCode=0
Sep 11 18:43:18.484376 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.484205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc" event={"ID":"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5","Type":"ContainerDied","Data":"370cccb0425198250171ea76fbeeeaabe24ff9d464e9c1f5044dd2f14bd94ea8"}
Sep 11 18:43:18.487108 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.487084    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"]
Sep 11 18:43:18.497138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.497116    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b63ece-srnj8"]
Sep 11 18:43:18.510585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.510495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:18.602940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.602902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:18.825272 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:18.825242    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:19.332745 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:19.332714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:19.651238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:19.651216    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:19.747753 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:19.747722    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5-maas-api-service-ca\") pod \"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5\" (UID: \"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5\") "
Sep 11 18:43:19.748049 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:19.748028    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5" (UID: "9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:43:19.849459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:19.849426    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:19.910682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:19.910599    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e828388b-507b-438d-92be-644dc7e7cdd9" path="/var/lib/kubelet/pods/e828388b-507b-438d-92be-644dc7e7cdd9/volumes"
Sep 11 18:43:20.021574 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.021538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:20.323163 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.323123    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z" podUID="0967ca80-a8b9-423a-be5f-4311e7e19417" containerName="main" containerID="cri-o://cb62c0a090bc4736f6a55c40bad2853cbd5b3da848fdfd1db3e6cc0b034fad19" gracePeriod=45
Sep 11 18:43:20.502368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.502339    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"
Sep 11 18:43:20.502368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.502350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc" event={"ID":"9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5","Type":"ContainerDied","Data":"43901c028259418e4402cdb79c3a66264d2e5aa009f0b8bbd65270339f657bdd"}
Sep 11 18:43:20.502838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.502410    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43901c028259418e4402cdb79c3a66264d2e5aa009f0b8bbd65270339f657bdd"
Sep 11 18:43:20.504517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.504397    2561 generic.go:356] "Generic (PLEG): container finished" podID="0967ca80-a8b9-423a-be5f-4311e7e19417" containerID="cb62c0a090bc4736f6a55c40bad2853cbd5b3da848fdfd1db3e6cc0b034fad19" exitCode=0
Sep 11 18:43:20.504517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.504421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z" event={"ID":"0967ca80-a8b9-423a-be5f-4311e7e19417","Type":"ContainerDied","Data":"cb62c0a090bc4736f6a55c40bad2853cbd5b3da848fdfd1db3e6cc0b034fad19"}
Sep 11 18:43:20.576528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.576460    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:43:20.658414 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658383    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-home\") pod \"0967ca80-a8b9-423a-be5f-4311e7e19417\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") "
Sep 11 18:43:20.658576 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658439    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-model-cache\") pod \"0967ca80-a8b9-423a-be5f-4311e7e19417\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") "
Sep 11 18:43:20.658576 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658460    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-dshm\") pod \"0967ca80-a8b9-423a-be5f-4311e7e19417\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") "
Sep 11 18:43:20.658576 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658491    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0967ca80-a8b9-423a-be5f-4311e7e19417-tls-certs\") pod \"0967ca80-a8b9-423a-be5f-4311e7e19417\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") "
Sep 11 18:43:20.658686 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658604    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvzz9\" (UniqueName: \"kubernetes.io/projected/0967ca80-a8b9-423a-be5f-4311e7e19417-kube-api-access-rvzz9\") pod \"0967ca80-a8b9-423a-be5f-4311e7e19417\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") "
Sep 11 18:43:20.658731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658686    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-tmp-dir\") pod \"0967ca80-a8b9-423a-be5f-4311e7e19417\" (UID: \"0967ca80-a8b9-423a-be5f-4311e7e19417\") "
Sep 11 18:43:20.658731 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658682    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-home" (OuterVolumeSpecName: "home") pod "0967ca80-a8b9-423a-be5f-4311e7e19417" (UID: "0967ca80-a8b9-423a-be5f-4311e7e19417"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:20.658824 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.658726    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-model-cache" (OuterVolumeSpecName: "model-cache") pod "0967ca80-a8b9-423a-be5f-4311e7e19417" (UID: "0967ca80-a8b9-423a-be5f-4311e7e19417"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:20.659043 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.659008    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0967ca80-a8b9-423a-be5f-4311e7e19417" (UID: "0967ca80-a8b9-423a-be5f-4311e7e19417"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:20.659182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.659162    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:20.659248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.659188    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:20.659248 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.659203    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:20.660981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.660954    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0967ca80-a8b9-423a-be5f-4311e7e19417-kube-api-access-rvzz9" (OuterVolumeSpecName: "kube-api-access-rvzz9") pod "0967ca80-a8b9-423a-be5f-4311e7e19417" (UID: "0967ca80-a8b9-423a-be5f-4311e7e19417"). InnerVolumeSpecName "kube-api-access-rvzz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:20.661245 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.661224    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-dshm" (OuterVolumeSpecName: "dshm") pod "0967ca80-a8b9-423a-be5f-4311e7e19417" (UID: "0967ca80-a8b9-423a-be5f-4311e7e19417"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:20.661245 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.661229    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0967ca80-a8b9-423a-be5f-4311e7e19417-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0967ca80-a8b9-423a-be5f-4311e7e19417" (UID: "0967ca80-a8b9-423a-be5f-4311e7e19417"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:43:20.760830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.760796    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvzz9\" (UniqueName: \"kubernetes.io/projected/0967ca80-a8b9-423a-be5f-4311e7e19417-kube-api-access-rvzz9\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:20.760830 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.760828    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0967ca80-a8b9-423a-be5f-4311e7e19417-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:20.761034 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.760841    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0967ca80-a8b9-423a-be5f-4311e7e19417-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:20.794584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:20.794535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:21.450846 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.450800    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:21.512789 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.512730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z" event={"ID":"0967ca80-a8b9-423a-be5f-4311e7e19417","Type":"ContainerDied","Data":"8cddfcd2ac7791ec74e1ad1a96df1985b26f1187f9a71a928e2aaa7e38b5e913"}
Sep 11 18:43:21.513262 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.512814    2561 scope.go:117] "RemoveContainer" containerID="cb62c0a090bc4736f6a55c40bad2853cbd5b3da848fdfd1db3e6cc0b034fad19"
Sep 11 18:43:21.513262 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.512762    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"
Sep 11 18:43:21.542910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.542882    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"]
Sep 11 18:43:21.546479 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.546453    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b63ece/embedding-w0-b63ece-kserve-5b4d86d64-lmg6z"]
Sep 11 18:43:21.909111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:21.909077    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0967ca80-a8b9-423a-be5f-4311e7e19417" path="/var/lib/kubelet/pods/0967ca80-a8b9-423a-be5f-4311e7e19417/volumes"
Sep 11 18:43:22.259889 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:22.259857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:23.225854 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:23.225819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:23.327964 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:23.327924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:24.160806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:24.160777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:24.965809 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:24.965768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:25.075759 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:25.075724    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:25.246079 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:25.245982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:25.313914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:25.313881    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"]
Sep 11 18:43:25.314126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:25.314104    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy" containerID="cri-o://59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20" gracePeriod=30
Sep 11 18:43:25.381585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:25.381552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:26.743932 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:26.743895    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:30.565295 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.565262    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:43:30.576063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576037    2561 generic.go:356] "Generic (PLEG): container finished" podID="54be3229-4537-4fa6-a249-355616de6418" containerID="59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20" exitCode=0
Sep 11 18:43:30.576173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576076    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"
Sep 11 18:43:30.576173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" event={"ID":"54be3229-4537-4fa6-a249-355616de6418","Type":"ContainerDied","Data":"59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20"}
Sep 11 18:43:30.576173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8" event={"ID":"54be3229-4537-4fa6-a249-355616de6418","Type":"ContainerDied","Data":"8d147ddd21215f2a03ff8d23f4f0e2f48b3d81093bafb281826a48bfc868ff6f"}
Sep 11 18:43:30.576173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576150    2561 scope.go:117] "RemoveContainer" containerID="59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20"
Sep 11 18:43:30.576916 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576896    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-credential-socket\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.576971    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q445k\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-kube-api-access-q445k\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577061 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577004    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54be3229-4537-4fa6-a249-355616de6418-istiod-ca-cert\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577112 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577065    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-data\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-envoy\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577166    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-istio-token\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577207    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:30.577238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-certs\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54be3229-4537-4fa6-a249-355616de6418-istio-podinfo\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577391    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-data" (OuterVolumeSpecName: "istio-data") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:30.577467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577404    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-socket\") pod \"54be3229-4537-4fa6-a249-355616de6418\" (UID: \"54be3229-4537-4fa6-a249-355616de6418\") "
Sep 11 18:43:30.577467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577449    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:30.577734 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577493    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54be3229-4537-4fa6-a249-355616de6418-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:43:30.577734 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577695    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:30.577982 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577960    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.578060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.577986    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.578060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.578001    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54be3229-4537-4fa6-a249-355616de6418-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.578060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.578015    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.578060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.578028    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.579482 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.579424    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:30.579482 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.579441    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54be3229-4537-4fa6-a249-355616de6418-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:43:30.579880 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.579861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-istio-token" (OuterVolumeSpecName: "istio-token") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:30.579941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.579892    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-kube-api-access-q445k" (OuterVolumeSpecName: "kube-api-access-q445k") pod "54be3229-4537-4fa6-a249-355616de6418" (UID: "54be3229-4537-4fa6-a249-355616de6418"). InnerVolumeSpecName "kube-api-access-q445k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:30.605173 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.605154    2561 scope.go:117] "RemoveContainer" containerID="89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"
Sep 11 18:43:30.616445 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.616422    2561 scope.go:117] "RemoveContainer" containerID="59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20"
Sep 11 18:43:30.616786 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:43:30.616764    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20\": container with ID starting with 59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20 not found: ID does not exist" containerID="59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20"
Sep 11 18:43:30.616845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.616795    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20"} err="failed to get container status \"59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20\": rpc error: code = NotFound desc = could not find container \"59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20\": container with ID starting with 59bdb94fd08c19295a360cea50cf25843c95c4e6fce3a46381878874613c0a20 not found: ID does not exist"
Sep 11 18:43:30.616845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.616812    2561 scope.go:117] "RemoveContainer" containerID="89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"
Sep 11 18:43:30.617115 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:43:30.617094    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2\": container with ID starting with 89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2 not found: ID does not exist" containerID="89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"
Sep 11 18:43:30.617178 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.617124    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2"} err="failed to get container status \"89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2\": rpc error: code = NotFound desc = could not find container \"89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2\": container with ID starting with 89fa489e9c9ad390dad4da246dc9b6782051510089fe7b109403dd99761f3aa2 not found: ID does not exist"
Sep 11 18:43:30.679341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.679320    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q445k\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-kube-api-access-q445k\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.679341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.679340    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54be3229-4537-4fa6-a249-355616de6418-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.679466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.679351    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54be3229-4537-4fa6-a249-355616de6418-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.679466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.679359    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54be3229-4537-4fa6-a249-355616de6418-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:30.916915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.916877    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"]
Sep 11 18:43:30.925101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:30.925076    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8"]
Sep 11 18:43:31.908888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:31.908851    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54be3229-4537-4fa6-a249-355616de6418" path="/var/lib/kubelet/pods/54be3229-4537-4fa6-a249-355616de6418/volumes"
Sep 11 18:43:32.520620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.520590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:32.602572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.602532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:32.667919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.667891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:32.731295 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.731256    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"]
Sep 11 18:43:32.734587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.734565    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6c4c23-gzkgc"]
Sep 11 18:43:32.736395 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.736364    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:32.800324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:32.800248    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:33.109247 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:33.109153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:33.210547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:33.210515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:33.908355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:33.908317    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5" path="/var/lib/kubelet/pods/9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5/volumes"
Sep 11 18:43:33.939544 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:33.939515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:34.838662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:34.838626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:35.642700 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:35.642664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:35.843115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:35.843083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:35.942781 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:35.942699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:36.440437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:36.440404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:37.424555 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:37.424517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:37.712466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:37.712371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:38.222615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:38.222585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:39.360124 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:39.360085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:39.476833 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:39.476792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:39.636092 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:39.636009    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"]
Sep 11 18:43:39.636240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:39.636218    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy" containerID="cri-o://d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440" gracePeriod=30
Sep 11 18:43:39.650920 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:39.650886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:40.327556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:40.327514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:41.148672 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:41.148640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:42.077861 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:42.077830    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:42.888673 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:42.888632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:43.730284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:43.730245    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:44.431438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:44.431402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:44.907810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:44.907783    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:43:45.042535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042503    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-podinfo\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.042723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042544    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48n2t\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-kube-api-access-48n2t\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.042723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042588    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-socket\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.042723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-token\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.042723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042649    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-data\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.042723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-envoy\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.042723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042705    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-credential-socket\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.043056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042746    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf74ece-addf-46ba-9cea-c912329e5b0b-istiod-ca-cert\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.043056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-certs\") pod \"ecf74ece-addf-46ba-9cea-c912329e5b0b\" (UID: \"ecf74ece-addf-46ba-9cea-c912329e5b0b\") "
Sep 11 18:43:45.043056 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.042987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:45.043220 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.043142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:45.043409 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.043382    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:45.043520 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.043492    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:45.043584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.043528    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.043584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.043552    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.043707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.043688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf74ece-addf-46ba-9cea-c912329e5b0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:43:45.045011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.044983    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:43:45.045265 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.045246    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:43:45.045360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.045342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:45.045523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.045496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-kube-api-access-48n2t" (OuterVolumeSpecName: "kube-api-access-48n2t") pod "ecf74ece-addf-46ba-9cea-c912329e5b0b" (UID: "ecf74ece-addf-46ba-9cea-c912329e5b0b"). InnerVolumeSpecName "kube-api-access-48n2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:43:45.137568 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.137531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:45.144831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144807    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.144831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144830    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.144831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144838    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.145045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144847    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf74ece-addf-46ba-9cea-c912329e5b0b-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.145045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144856    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf74ece-addf-46ba-9cea-c912329e5b0b-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.145045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144863    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf74ece-addf-46ba-9cea-c912329e5b0b-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.145045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.144871    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48n2t\" (UniqueName: \"kubernetes.io/projected/ecf74ece-addf-46ba-9cea-c912329e5b0b-kube-api-access-48n2t\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:43:45.695059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.695018    2561 generic.go:356] "Generic (PLEG): container finished" podID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerID="d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440" exitCode=0
Sep 11 18:43:45.695461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.695073    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"
Sep 11 18:43:45.695461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.695073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" event={"ID":"ecf74ece-addf-46ba-9cea-c912329e5b0b","Type":"ContainerDied","Data":"d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440"}
Sep 11 18:43:45.695461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.695128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk" event={"ID":"ecf74ece-addf-46ba-9cea-c912329e5b0b","Type":"ContainerDied","Data":"93818ff81ce7556454ca6644cae6987a86ad117ae80473b6813dcd3afdd5a460"}
Sep 11 18:43:45.695461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.695158    2561 scope.go:117] "RemoveContainer" containerID="d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440"
Sep 11 18:43:45.706973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.706956    2561 scope.go:117] "RemoveContainer" containerID="8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"
Sep 11 18:43:45.716132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.716107    2561 scope.go:117] "RemoveContainer" containerID="d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440"
Sep 11 18:43:45.716855 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:43:45.716821    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440\": container with ID starting with d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440 not found: ID does not exist" containerID="d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440"
Sep 11 18:43:45.717006 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.716856    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440"} err="failed to get container status \"d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440\": rpc error: code = NotFound desc = could not find container \"d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440\": container with ID starting with d19117ce675950c4ba3e740665620bfae86bc0eb9e838b311d483bbc92c95440 not found: ID does not exist"
Sep 11 18:43:45.717006 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.716875    2561 scope.go:117] "RemoveContainer" containerID="8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"
Sep 11 18:43:45.717148 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:43:45.717130    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b\": container with ID starting with 8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b not found: ID does not exist" containerID="8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"
Sep 11 18:43:45.717203 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.717150    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b"} err="failed to get container status \"8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b\": rpc error: code = NotFound desc = could not find container \"8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b\": container with ID starting with 8f8484f1f437b57c8d9f1f67afd5430c2000533932a9b3273553e43150947e9b not found: ID does not exist"
Sep 11 18:43:45.719796 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.719773    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"]
Sep 11 18:43:45.725373 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.725352    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk"]
Sep 11 18:43:45.908492 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:45.908460    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" path="/var/lib/kubelet/pods/ecf74ece-addf-46ba-9cea-c912329e5b0b/volumes"
Sep 11 18:43:46.025246 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:46.025181    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:53.124886 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:53.124842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:55.522455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:55.522412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:55.622269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:55.622231    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:55.718331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:55.718284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:55.779530 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:55.779426    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:56.098928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:56.098836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:56.202693 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:56.202664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:56.689738 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:56.689670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:56.789899 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:56.789870    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:56.926750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:56.926719    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:57.830775 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:57.830742    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:58.276351 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:58.276320    2561 scope.go:117] "RemoveContainer" containerID="16f58a434d155c1990524c3c39691084f00796de8426eed88a7fe0fe19114be2"
Sep 11 18:43:58.286113 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:58.286087    2561 scope.go:117] "RemoveContainer" containerID="97d32772466d520789ae27b3983575c94c7dbd05621f3de766e3686e2e863e17"
Sep 11 18:43:58.535612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:58.535528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:43:59.333934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:43:59.333901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:00.054508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:00.054473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:01.898179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:01.898144    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:02.004359 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:02.004321    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:02.150120 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:02.150042    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"]
Sep 11 18:44:02.150269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:02.150250    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy" containerID="cri-o://a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4" gracePeriod=30
Sep 11 18:44:02.170239 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:02.170210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:02.756894 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:02.756841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:03.751499 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:03.751465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:04.467552 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:04.467516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:05.404787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:05.404754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:06.059442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:06.059381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:06.813501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:06.813465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:07.410109 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.410040    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:44:07.485540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-credential-socket\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485745 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485584    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383d9c2f-c4d8-4097-9687-599544726d0d-istio-podinfo\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485745 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485620    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383d9c2f-c4d8-4097-9687-599544726d0d-istiod-ca-cert\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485745 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr58n\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-kube-api-access-hr58n\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485749    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-certs\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485799    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-envoy\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485824    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-istio-token\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:07.485929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485849    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-socket\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.485929 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.485904    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-data\") pod \"383d9c2f-c4d8-4097-9687-599544726d0d\" (UID: \"383d9c2f-c4d8-4097-9687-599544726d0d\") "
Sep 11 18:44:07.486233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486070    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:07.486233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486098    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/383d9c2f-c4d8-4097-9687-599544726d0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:44:07.486360 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486338    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:07.486419 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486354    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:07.486591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486570    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383d9c2f-c4d8-4097-9687-599544726d0d-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.486591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486592    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.486749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486604    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.486749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486617    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.486749 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.486628    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.488145 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.488113    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/383d9c2f-c4d8-4097-9687-599544726d0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:44:07.488145 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.488127    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-kube-api-access-hr58n" (OuterVolumeSpecName: "kube-api-access-hr58n") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "kube-api-access-hr58n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:07.488416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.488394    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:07.488468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.488436    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "383d9c2f-c4d8-4097-9687-599544726d0d" (UID: "383d9c2f-c4d8-4097-9687-599544726d0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:07.555649 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.555597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:07.588047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.588018    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr58n\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-kube-api-access-hr58n\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.588047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.588045    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383d9c2f-c4d8-4097-9687-599544726d0d-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.588235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.588056    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383d9c2f-c4d8-4097-9687-599544726d0d-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.588235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.588065    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383d9c2f-c4d8-4097-9687-599544726d0d-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:07.854965 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.854924    2561 generic.go:356] "Generic (PLEG): container finished" podID="383d9c2f-c4d8-4097-9687-599544726d0d" containerID="a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4" exitCode=0
Sep 11 18:44:07.855431 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.854970    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"
Sep 11 18:44:07.855431 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.855003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" event={"ID":"383d9c2f-c4d8-4097-9687-599544726d0d","Type":"ContainerDied","Data":"a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4"}
Sep 11 18:44:07.855431 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.855060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4" event={"ID":"383d9c2f-c4d8-4097-9687-599544726d0d","Type":"ContainerDied","Data":"41622c95998326a57f16cedee3a4dd8d18d6798fb4a6a414e18b600e3ae311c3"}
Sep 11 18:44:07.855431 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.855088    2561 scope.go:117] "RemoveContainer" containerID="a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4"
Sep 11 18:44:07.865594 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.865573    2561 scope.go:117] "RemoveContainer" containerID="808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"
Sep 11 18:44:07.879038 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.879019    2561 scope.go:117] "RemoveContainer" containerID="a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4"
Sep 11 18:44:07.879556 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:07.879418    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4\": container with ID starting with a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4 not found: ID does not exist" containerID="a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4"
Sep 11 18:44:07.879556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.879458    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4"} err="failed to get container status \"a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4\": rpc error: code = NotFound desc = could not find container \"a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4\": container with ID starting with a421cf24c6021d19dd25929bc06024b217bcd20d69c89393e30e36ec19ee22a4 not found: ID does not exist"
Sep 11 18:44:07.879556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.879482    2561 scope.go:117] "RemoveContainer" containerID="808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"
Sep 11 18:44:07.880107 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:07.880082    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e\": container with ID starting with 808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e not found: ID does not exist" containerID="808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"
Sep 11 18:44:07.880216 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.880111    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e"} err="failed to get container status \"808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e\": rpc error: code = NotFound desc = could not find container \"808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e\": container with ID starting with 808e530d8c00afa066f13301e0689bd5056006c076faa4728f0536d6934e890e not found: ID does not exist"
Sep 11 18:44:07.882413 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.882394    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"]
Sep 11 18:44:07.885197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.885178    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4"]
Sep 11 18:44:07.908186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:07.908160    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" path="/var/lib/kubelet/pods/383d9c2f-c4d8-4097-9687-599544726d0d/volumes"
Sep 11 18:44:09.157939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:09.157880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:09.614395 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:09.614354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:10.275789 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:10.275763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:10.926696 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:10.926656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:11.751571 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:11.751531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:12.535140 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:12.535090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:13.329052 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:13.329018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.025315 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.025272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.235665 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.235620    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.647550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.647499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.717568 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.717533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.780580 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.780542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.849823 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.849784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:14.913588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:14.913511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:15.311186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:15.311148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:15.452368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:15.452336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:16.232407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:16.232374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:16.915658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:16.915623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:17.908177 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:17.908138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:18.862733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:18.862697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:21.795994 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:21.795907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:21.896064 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:21.896028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:22.077264 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:22.077180    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"]
Sep 11 18:44:22.077422 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:22.077390    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy" containerID="cri-o://b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda" gracePeriod=30
Sep 11 18:44:22.095406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:22.095370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:22.775550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:22.775518    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:23.393202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.393160    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"]
Sep 11 18:44:23.393630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.393485    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" podUID="2ff06d2e-907e-490b-bc65-b0d7f88d928d" containerName="maas-api" containerID="cri-o://aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f" gracePeriod=30
Sep 11 18:44:23.441572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.441536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:23.539102 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.539065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:23.621856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.621821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:23.647934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.647866    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:44:23.727155 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.727117    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:23.764309 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.764268    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls\") pod \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") "
Sep 11 18:44:23.764462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.764324    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff06d2e-907e-490b-bc65-b0d7f88d928d-openshift-service-ca\") pod \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") "
Sep 11 18:44:23.764462 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.764351    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-metrics-certs\") pod \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") "
Sep 11 18:44:23.764551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.764465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkn7b\" (UniqueName: \"kubernetes.io/projected/2ff06d2e-907e-490b-bc65-b0d7f88d928d-kube-api-access-nkn7b\") pod \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\" (UID: \"2ff06d2e-907e-490b-bc65-b0d7f88d928d\") "
Sep 11 18:44:23.764708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.764676    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff06d2e-907e-490b-bc65-b0d7f88d928d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ff06d2e-907e-490b-bc65-b0d7f88d928d" (UID: "2ff06d2e-907e-490b-bc65-b0d7f88d928d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:44:23.764859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.764843    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff06d2e-907e-490b-bc65-b0d7f88d928d-openshift-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:23.766426 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.766404    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ff06d2e-907e-490b-bc65-b0d7f88d928d" (UID: "2ff06d2e-907e-490b-bc65-b0d7f88d928d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:44:23.766526 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.766481    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff06d2e-907e-490b-bc65-b0d7f88d928d-kube-api-access-nkn7b" (OuterVolumeSpecName: "kube-api-access-nkn7b") pod "2ff06d2e-907e-490b-bc65-b0d7f88d928d" (UID: "2ff06d2e-907e-490b-bc65-b0d7f88d928d"). InnerVolumeSpecName "kube-api-access-nkn7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:23.766577 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.766554    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2ff06d2e-907e-490b-bc65-b0d7f88d928d" (UID: "2ff06d2e-907e-490b-bc65-b0d7f88d928d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:44:23.844572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.844535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:23.865551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.865527    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkn7b\" (UniqueName: \"kubernetes.io/projected/2ff06d2e-907e-490b-bc65-b0d7f88d928d-kube-api-access-nkn7b\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:23.865551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.865551    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-maas-api-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:23.865708 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.865560    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff06d2e-907e-490b-bc65-b0d7f88d928d-metrics-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:23.965811 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.965783    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ff06d2e-907e-490b-bc65-b0d7f88d928d" containerID="aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f" exitCode=0
Sep 11 18:44:23.965949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.965836    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"
Sep 11 18:44:23.965949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.965866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" event={"ID":"2ff06d2e-907e-490b-bc65-b0d7f88d928d","Type":"ContainerDied","Data":"aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f"}
Sep 11 18:44:23.965949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.965929    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq" event={"ID":"2ff06d2e-907e-490b-bc65-b0d7f88d928d","Type":"ContainerDied","Data":"53c832cb23daf474294d1ec77e63c3d6e4c91c957f65afd3f805f92c638c20cd"}
Sep 11 18:44:23.966104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.965958    2561 scope.go:117] "RemoveContainer" containerID="aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f"
Sep 11 18:44:23.980727 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.980689    2561 scope.go:117] "RemoveContainer" containerID="aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f"
Sep 11 18:44:23.981224 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:23.981191    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f\": container with ID starting with aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f not found: ID does not exist" containerID="aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f"
Sep 11 18:44:23.981389 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:23.981242    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f"} err="failed to get container status \"aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f\": rpc error: code = NotFound desc = could not find container \"aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f\": container with ID starting with aed9611d720918e52576eba558f252de83fa995108024d29b16db5e5d5e1b35f not found: ID does not exist"
Sep 11 18:44:24.000678 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:24.000651    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"]
Sep 11 18:44:24.013197 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:24.013169    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-c8b274-cd47f94c9-btpkq"]
Sep 11 18:44:24.062347 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:24.062315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:24.310054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:24.310019    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:25.174577 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:25.174540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:25.908257 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:25.908224    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff06d2e-907e-490b-bc65-b0d7f88d928d" path="/var/lib/kubelet/pods/2ff06d2e-907e-490b-bc65-b0d7f88d928d/volumes"
Sep 11 18:44:26.158627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:26.158552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:26.959598 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:26.959562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:27.332095 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.332071    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:44:27.503946 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.503918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-credential-socket\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.503976    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-socket\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnkck\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-kube-api-access-mnkck\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504073    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-envoy\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-data\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504110    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-podinfo\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504141    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b41ab01f-6184-4ebc-aa5f-56713e349e45-istiod-ca-cert\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-token\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504194    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:27.504276 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-certs\") pod \"b41ab01f-6184-4ebc-aa5f-56713e349e45\" (UID: \"b41ab01f-6184-4ebc-aa5f-56713e349e45\") "
Sep 11 18:44:27.504559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:27.504559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-data" (OuterVolumeSpecName: "istio-data") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:27.504559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:27.504748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504626    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41ab01f-6184-4ebc-aa5f-56713e349e45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:44:27.504748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504721    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.504748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504741    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b41ab01f-6184-4ebc-aa5f-56713e349e45-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.504913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504756    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.504913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504768    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.504913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.504780    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.506471 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.506436    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:44:27.506625 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.506607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-kube-api-access-mnkck" (OuterVolumeSpecName: "kube-api-access-mnkck") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "kube-api-access-mnkck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:27.506795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.506779    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:27.506889 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.506870    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-token" (OuterVolumeSpecName: "istio-token") pod "b41ab01f-6184-4ebc-aa5f-56713e349e45" (UID: "b41ab01f-6184-4ebc-aa5f-56713e349e45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:27.605587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.605557    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnkck\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-kube-api-access-mnkck\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.605587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.605582    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.605587 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.605593    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.605803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.605601    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b41ab01f-6184-4ebc-aa5f-56713e349e45-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:27.841763 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.841665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:27.996184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.996151    2561 generic.go:356] "Generic (PLEG): container finished" podID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerID="b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda" exitCode=0
Sep 11 18:44:27.996559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.996222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" event={"ID":"b41ab01f-6184-4ebc-aa5f-56713e349e45","Type":"ContainerDied","Data":"b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda"}
Sep 11 18:44:27.996559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.996237    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"
Sep 11 18:44:27.996559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.996267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698" event={"ID":"b41ab01f-6184-4ebc-aa5f-56713e349e45","Type":"ContainerDied","Data":"e00ebb263fb5a733e1165f2d08768f35c28a8a915dda692edb96540f47f5dd3b"}
Sep 11 18:44:27.996559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:27.996290    2561 scope.go:117] "RemoveContainer" containerID="b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda"
Sep 11 18:44:28.006533 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.006514    2561 scope.go:117] "RemoveContainer" containerID="e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"
Sep 11 18:44:28.018685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.018652    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"]
Sep 11 18:44:28.019456 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.019435    2561 scope.go:117] "RemoveContainer" containerID="b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda"
Sep 11 18:44:28.020209 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:28.020179    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda\": container with ID starting with b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda not found: ID does not exist" containerID="b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda"
Sep 11 18:44:28.020295 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.020220    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda"} err="failed to get container status \"b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda\": rpc error: code = NotFound desc = could not find container \"b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda\": container with ID starting with b8a5939bef853c095e7bd9b36fc71ed37d99401937b40909071a3a4741209cda not found: ID does not exist"
Sep 11 18:44:28.020295 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.020246    2561 scope.go:117] "RemoveContainer" containerID="e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"
Sep 11 18:44:28.020659 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:28.020636    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385\": container with ID starting with e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385 not found: ID does not exist" containerID="e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"
Sep 11 18:44:28.020733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.020666    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385"} err="failed to get container status \"e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385\": rpc error: code = NotFound desc = could not find container \"e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385\": container with ID starting with e205b4883f0e575282efb37f326793e5e9edd1e2afdfdf9c59f5cb02e3dc8385 not found: ID does not exist"
Sep 11 18:44:28.022906 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:28.022862    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698"]
Sep 11 18:44:29.909290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:29.909252    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" path="/var/lib/kubelet/pods/b41ab01f-6184-4ebc-aa5f-56713e349e45/volumes"
Sep 11 18:44:30.707127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:30.707091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:30.806794 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:30.806754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:30.984720 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:30.984642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:32.637689 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:32.637630    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.230330 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.230282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.308583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.308527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.382193 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.382156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.448788 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.448749    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.516458 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.516425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.832845 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.832752    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:33.933612 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:33.933579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:34.641503 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:34.641471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:35.342240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:35.342206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:39.654189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:39.654156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:39.725966 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:39.725886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:39.909466 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:39.909386    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"]
Sep 11 18:44:39.909616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:39.909573    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy" containerID="cri-o://c2a846c00031b2fc3def240c7a91978589694fc5ca62e0dc4eae35254a424e5e" gracePeriod=30
Sep 11 18:44:39.937491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:39.937460    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:45.114270 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.114236    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerID="c2a846c00031b2fc3def240c7a91978589694fc5ca62e0dc4eae35254a424e5e" exitCode=0
Sep 11 18:44:45.114614 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.114321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" event={"ID":"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0","Type":"ContainerDied","Data":"c2a846c00031b2fc3def240c7a91978589694fc5ca62e0dc4eae35254a424e5e"}
Sep 11 18:44:45.114614 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.114429    2561 scope.go:117] "RemoveContainer" containerID="b62822a853de70dd89669b90ffe0f2a612b707c4662b6c85a6162eee46753001"
Sep 11 18:44:45.161974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.161954    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:44:45.277395 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-data\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277429    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istiod-ca-cert\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-certs\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277511    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8gzb\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-kube-api-access-w8gzb\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-envoy\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277567    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-socket\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-credential-socket\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277672    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-podinfo\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277703    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-token\") pod \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\" (UID: \"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0\") "
Sep 11 18:44:45.277849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:45.277849 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277792    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:45.278103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277915    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:45.278103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277928    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:45.278103 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.277934    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:44:45.278213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.278146    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.278213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.278167    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.278213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.278182    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.278213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.278195    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.278213 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.278207    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.280001 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.279978    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-kube-api-access-w8gzb" (OuterVolumeSpecName: "kube-api-access-w8gzb") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "kube-api-access-w8gzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:45.280111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.280006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:45.280198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.280181    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:44:45.280265 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.280247    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" (UID: "7f5e2657-c836-4a70-b4d2-d9dc2132a9e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:44:45.378803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.378778    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.378803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.378804    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.378988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.378818    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8gzb\" (UniqueName: \"kubernetes.io/projected/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-kube-api-access-w8gzb\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:45.378988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:45.378830    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:46.121956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:46.121928    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"
Sep 11 18:44:46.121956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:46.121943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb" event={"ID":"7f5e2657-c836-4a70-b4d2-d9dc2132a9e0","Type":"ContainerDied","Data":"d5cd7a380f2850071140258749d97c08db317cd6faab1de69cd5165210980a01"}
Sep 11 18:44:46.122467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:46.122008    2561 scope.go:117] "RemoveContainer" containerID="c2a846c00031b2fc3def240c7a91978589694fc5ca62e0dc4eae35254a424e5e"
Sep 11 18:44:46.141626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:46.141601    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"]
Sep 11 18:44:46.144412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:46.144388    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb"]
Sep 11 18:44:47.535445 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535414    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-9929f2"]
Sep 11 18:44:47.535870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535858    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy"
Sep 11 18:44:47.535913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535871    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy"
Sep 11 18:44:47.535913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535883    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy"
Sep 11 18:44:47.535913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535888    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy"
Sep 11 18:44:47.535913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535903    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy"
Sep 11 18:44:47.535913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535909    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535915    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0967ca80-a8b9-423a-be5f-4311e7e19417" containerName="main"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535920    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0967ca80-a8b9-423a-be5f-4311e7e19417" containerName="main"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535927    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535933    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535939    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535945    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535952    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535957    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535962    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535967    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535980    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff06d2e-907e-490b-bc65-b0d7f88d928d" containerName="maas-api"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535985    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff06d2e-907e-490b-bc65-b0d7f88d928d" containerName="maas-api"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535990    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.535995    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536003    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5" containerName="revoke-keys"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536008    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5" containerName="revoke-keys"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536026    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy"
Sep 11 18:44:47.536066 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536031    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536096    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536105    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536110    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536117    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2f6617-adb4-4c0e-bcc6-b2dc5bb033e5" containerName="revoke-keys"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536124    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff06d2e-907e-490b-bc65-b0d7f88d928d" containerName="maas-api"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536128    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0967ca80-a8b9-423a-be5f-4311e7e19417" containerName="main"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536133    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536138    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536145    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy"
Sep 11 18:44:47.536859 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.536149    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="383d9c2f-c4d8-4097-9687-599544726d0d" containerName="istio-proxy"
Sep 11 18:44:47.539486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.539470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:47.542286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.542266    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t65h9\""
Sep 11 18:44:47.548666 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.548641    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-9929f2"]
Sep 11 18:44:47.600017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.599992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghsqw\" (UniqueName: \"kubernetes.io/projected/403624ea-3051-47f0-81ba-6fbdc054f92d-kube-api-access-ghsqw\") pod \"test-curl-7542-9929f2\" (UID: \"403624ea-3051-47f0-81ba-6fbdc054f92d\") " pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:47.701636 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.701605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghsqw\" (UniqueName: \"kubernetes.io/projected/403624ea-3051-47f0-81ba-6fbdc054f92d-kube-api-access-ghsqw\") pod \"test-curl-7542-9929f2\" (UID: \"403624ea-3051-47f0-81ba-6fbdc054f92d\") " pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:47.713324 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.713275    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghsqw\" (UniqueName: \"kubernetes.io/projected/403624ea-3051-47f0-81ba-6fbdc054f92d-kube-api-access-ghsqw\") pod \"test-curl-7542-9929f2\" (UID: \"403624ea-3051-47f0-81ba-6fbdc054f92d\") " pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:47.850624 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.850559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:47.913014 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:47.912980    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5e2657-c836-4a70-b4d2-d9dc2132a9e0" path="/var/lib/kubelet/pods/7f5e2657-c836-4a70-b4d2-d9dc2132a9e0/volumes"
Sep 11 18:44:48.122191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:48.122167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-9929f2"]
Sep 11 18:44:48.123981 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:44:48.123951    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod403624ea_3051_47f0_81ba_6fbdc054f92d.slice/crio-85f06665da37184da09a9aa46b98d906ff324d7a442c91ef0bc0069228d6aabc WatchSource:0}: Error finding container 85f06665da37184da09a9aa46b98d906ff324d7a442c91ef0bc0069228d6aabc: Status 404 returned error can't find the container with id 85f06665da37184da09a9aa46b98d906ff324d7a442c91ef0bc0069228d6aabc
Sep 11 18:44:48.140718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:48.140684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-9929f2" event={"ID":"403624ea-3051-47f0-81ba-6fbdc054f92d","Type":"ContainerStarted","Data":"85f06665da37184da09a9aa46b98d906ff324d7a442c91ef0bc0069228d6aabc"}
Sep 11 18:44:49.148808 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:49.148772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-9929f2" event={"ID":"403624ea-3051-47f0-81ba-6fbdc054f92d","Type":"ContainerStarted","Data":"690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b"}
Sep 11 18:44:49.166464 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:49.166422    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7542-9929f2" podStartSLOduration=2.166406511 podStartE2EDuration="2.166406511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:44:49.164177991 +0000 UTC m=+1731.739281456" watchObservedRunningTime="2026-09-11 18:44:49.166406511 +0000 UTC m=+1731.741509978"
Sep 11 18:44:49.748710 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:49.748678    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-9929f2"]
Sep 11 18:44:49.754225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:49.754197    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-9929f2"]
Sep 11 18:44:50.155023 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:50.154991    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7542-9929f2" container="test-curl-7542-9929f2"
Sep 11 18:44:51.134070 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:51.134026    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:51.163385 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:51.163349    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7542-9929f2" podUID="403624ea-3051-47f0-81ba-6fbdc054f92d" containerName="test-curl-7542-9929f2" containerID="cri-o://690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b" gracePeriod=2
Sep 11 18:44:51.243235 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:51.242753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:51.345804 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:51.345714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:52.513632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:52.513593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:53.344878 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:53.344853    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:53.464867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:53.464793    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghsqw\" (UniqueName: \"kubernetes.io/projected/403624ea-3051-47f0-81ba-6fbdc054f92d-kube-api-access-ghsqw\") pod \"403624ea-3051-47f0-81ba-6fbdc054f92d\" (UID: \"403624ea-3051-47f0-81ba-6fbdc054f92d\") "
Sep 11 18:44:53.466877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:53.466845    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403624ea-3051-47f0-81ba-6fbdc054f92d-kube-api-access-ghsqw" (OuterVolumeSpecName: "kube-api-access-ghsqw") pod "403624ea-3051-47f0-81ba-6fbdc054f92d" (UID: "403624ea-3051-47f0-81ba-6fbdc054f92d"). InnerVolumeSpecName "kube-api-access-ghsqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:44:53.565615 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:53.565590    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghsqw\" (UniqueName: \"kubernetes.io/projected/403624ea-3051-47f0-81ba-6fbdc054f92d-kube-api-access-ghsqw\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:44:53.908702 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:53.908670    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403624ea-3051-47f0-81ba-6fbdc054f92d" path="/var/lib/kubelet/pods/403624ea-3051-47f0-81ba-6fbdc054f92d/volumes"
Sep 11 18:44:54.185679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.185582    2561 generic.go:356] "Generic (PLEG): container finished" podID="403624ea-3051-47f0-81ba-6fbdc054f92d" containerID="690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b" exitCode=137
Sep 11 18:44:54.185679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.185633    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-9929f2"
Sep 11 18:44:54.185679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.185656    2561 scope.go:117] "RemoveContainer" containerID="690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b"
Sep 11 18:44:54.195010 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.194989    2561 scope.go:117] "RemoveContainer" containerID="690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b"
Sep 11 18:44:54.195338 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:44:54.195294    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b\": container with ID starting with 690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b not found: ID does not exist" containerID="690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b"
Sep 11 18:44:54.195425 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.195349    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b"} err="failed to get container status \"690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b\": rpc error: code = NotFound desc = could not find container \"690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b\": container with ID starting with 690cde0cdc5a7e1b036f48c3feb985adb425b46cf28fd8381ec2ec174d3f581b not found: ID does not exist"
Sep 11 18:44:54.595107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.595075    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"]
Sep 11 18:44:54.615375 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:54.615349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:58.479910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:58.479867    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:44:58.580902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:44:58.580859    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:45:00.137703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.137665    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"]
Sep 11 18:45:00.138223 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138207    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403624ea-3051-47f0-81ba-6fbdc054f92d" containerName="test-curl-7542-9929f2"
Sep 11 18:45:00.138271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138225    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="403624ea-3051-47f0-81ba-6fbdc054f92d" containerName="test-curl-7542-9929f2"
Sep 11 18:45:00.138271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138251    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy"
Sep 11 18:45:00.138271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138257    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy"
Sep 11 18:45:00.138392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138340    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="403624ea-3051-47f0-81ba-6fbdc054f92d" containerName="test-curl-7542-9929f2"
Sep 11 18:45:00.138392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138353    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54be3229-4537-4fa6-a249-355616de6418" containerName="istio-proxy"
Sep 11 18:45:00.138392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138362    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf74ece-addf-46ba-9cea-c912329e5b0b" containerName="istio-proxy"
Sep 11 18:45:00.138392 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.138374    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b41ab01f-6184-4ebc-aa5f-56713e349e45" containerName="istio-proxy"
Sep 11 18:45:00.140547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.140531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"
Sep 11 18:45:00.144508 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.144488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:45:00.150898 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.150878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"
Sep 11 18:45:00.156461 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.156439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"]
Sep 11 18:45:00.426129 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:00.426099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"]
Sep 11 18:45:00.428152 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:45:00.428121    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5199c80_103d_4346_bf22_755a097f941c.slice/crio-22eaf8bdf204368873c0f009341f9a51b7eb5a8f49f66fbcd84f58d2ccff976e WatchSource:0}: Error finding container 22eaf8bdf204368873c0f009341f9a51b7eb5a8f49f66fbcd84f58d2ccff976e: Status 404 returned error can't find the container with id 22eaf8bdf204368873c0f009341f9a51b7eb5a8f49f66fbcd84f58d2ccff976e
Sep 11 18:45:01.236826 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:01.236793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl" event={"ID":"c5199c80-103d-4346-bf22-755a097f941c","Type":"ContainerStarted","Data":"c466c84bc69b2b5175bbdd1dfcb9a7e4f4902089cdbc74aa39040db5e837f796"}
Sep 11 18:45:01.237240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:01.236851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl" event={"ID":"c5199c80-103d-4346-bf22-755a097f941c","Type":"ContainerStarted","Data":"22eaf8bdf204368873c0f009341f9a51b7eb5a8f49f66fbcd84f58d2ccff976e"}
Sep 11 18:45:01.254053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:01.254003    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl" podStartSLOduration=1.253983732 podStartE2EDuration="1.253983732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:45:01.252469407 +0000 UTC m=+1743.827572876" watchObservedRunningTime="2026-09-11 18:45:01.253983732 +0000 UTC m=+1743.829087203"
Sep 11 18:45:02.244740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:02.244707    2561 generic.go:356] "Generic (PLEG): container finished" podID="c5199c80-103d-4346-bf22-755a097f941c" containerID="c466c84bc69b2b5175bbdd1dfcb9a7e4f4902089cdbc74aa39040db5e837f796" exitCode=0
Sep 11 18:45:02.245168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:02.244792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl" event={"ID":"c5199c80-103d-4346-bf22-755a097f941c","Type":"ContainerDied","Data":"c466c84bc69b2b5175bbdd1dfcb9a7e4f4902089cdbc74aa39040db5e837f796"}
Sep 11 18:45:03.386023 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:03.385995    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"
Sep 11 18:45:04.262663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:04.262629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl" event={"ID":"c5199c80-103d-4346-bf22-755a097f941c","Type":"ContainerDied","Data":"22eaf8bdf204368873c0f009341f9a51b7eb5a8f49f66fbcd84f58d2ccff976e"}
Sep 11 18:45:04.262663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:04.262661    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"
Sep 11 18:45:04.262869 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:04.262678    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22eaf8bdf204368873c0f009341f9a51b7eb5a8f49f66fbcd84f58d2ccff976e"
Sep 11 18:45:09.614414 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.614353    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4" podUID="70ed75c3-7982-46ec-9440-57daa12f9f6e" containerName="main" containerID="cri-o://5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620" gracePeriod=45
Sep 11 18:45:09.871579 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.871512    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:45:09.925494 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925463    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-dshm\") pod \"70ed75c3-7982-46ec-9440-57daa12f9f6e\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") "
Sep 11 18:45:09.925654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925503    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-model-cache\") pod \"70ed75c3-7982-46ec-9440-57daa12f9f6e\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") "
Sep 11 18:45:09.925654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-home\") pod \"70ed75c3-7982-46ec-9440-57daa12f9f6e\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") "
Sep 11 18:45:09.925654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ed75c3-7982-46ec-9440-57daa12f9f6e-tls-certs\") pod \"70ed75c3-7982-46ec-9440-57daa12f9f6e\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") "
Sep 11 18:45:09.925802 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b929j\" (UniqueName: \"kubernetes.io/projected/70ed75c3-7982-46ec-9440-57daa12f9f6e-kube-api-access-b929j\") pod \"70ed75c3-7982-46ec-9440-57daa12f9f6e\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") "
Sep 11 18:45:09.925802 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925686    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-tmp-dir\") pod \"70ed75c3-7982-46ec-9440-57daa12f9f6e\" (UID: \"70ed75c3-7982-46ec-9440-57daa12f9f6e\") "
Sep 11 18:45:09.925910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925828    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "70ed75c3-7982-46ec-9440-57daa12f9f6e" (UID: "70ed75c3-7982-46ec-9440-57daa12f9f6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:09.925910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-home" (OuterVolumeSpecName: "home") pod "70ed75c3-7982-46ec-9440-57daa12f9f6e" (UID: "70ed75c3-7982-46ec-9440-57daa12f9f6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:09.926014 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.925992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70ed75c3-7982-46ec-9440-57daa12f9f6e" (UID: "70ed75c3-7982-46ec-9440-57daa12f9f6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:09.926104 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.926084    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-tmp-dir\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:45:09.926172 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.926106    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-model-cache\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:45:09.926172 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.926117    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-home\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:45:09.927850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.927827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-dshm" (OuterVolumeSpecName: "dshm") pod "70ed75c3-7982-46ec-9440-57daa12f9f6e" (UID: "70ed75c3-7982-46ec-9440-57daa12f9f6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:45:09.927850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.927831    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ed75c3-7982-46ec-9440-57daa12f9f6e-kube-api-access-b929j" (OuterVolumeSpecName: "kube-api-access-b929j") pod "70ed75c3-7982-46ec-9440-57daa12f9f6e" (UID: "70ed75c3-7982-46ec-9440-57daa12f9f6e"). InnerVolumeSpecName "kube-api-access-b929j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:45:09.928015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:09.927886    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70ed75c3-7982-46ec-9440-57daa12f9f6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70ed75c3-7982-46ec-9440-57daa12f9f6e" (UID: "70ed75c3-7982-46ec-9440-57daa12f9f6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:45:10.027175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.027143    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b929j\" (UniqueName: \"kubernetes.io/projected/70ed75c3-7982-46ec-9440-57daa12f9f6e-kube-api-access-b929j\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:45:10.027175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.027170    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ed75c3-7982-46ec-9440-57daa12f9f6e-dshm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:45:10.027377 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.027182    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ed75c3-7982-46ec-9440-57daa12f9f6e-tls-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:45:10.303996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.303963    2561 generic.go:356] "Generic (PLEG): container finished" podID="70ed75c3-7982-46ec-9440-57daa12f9f6e" containerID="5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620" exitCode=0
Sep 11 18:45:10.304165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.304010    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"
Sep 11 18:45:10.304165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.304051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4" event={"ID":"70ed75c3-7982-46ec-9440-57daa12f9f6e","Type":"ContainerDied","Data":"5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620"}
Sep 11 18:45:10.304165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.304097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4" event={"ID":"70ed75c3-7982-46ec-9440-57daa12f9f6e","Type":"ContainerDied","Data":"c2b6bb3b0b0dbbf6db2c523e0385cfc7f140ef4b9b7acc996ceacf6b242f8f98"}
Sep 11 18:45:10.304165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.304117    2561 scope.go:117] "RemoveContainer" containerID="5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620"
Sep 11 18:45:10.313962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.313942    2561 scope.go:117] "RemoveContainer" containerID="5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620"
Sep 11 18:45:10.314267 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:45:10.314250    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620\": container with ID starting with 5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620 not found: ID does not exist" containerID="5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620"
Sep 11 18:45:10.314334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.314276    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620"} err="failed to get container status \"5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620\": rpc error: code = NotFound desc = could not find container \"5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620\": container with ID starting with 5f2b29f5e12e79d98f4a06ab1c32ed7431cc7eeacb9f78dadd884273dae45620 not found: ID does not exist"
Sep 11 18:45:10.327055 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.327031    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"]
Sep 11 18:45:10.331234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:10.331213    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w4-d6c4cc/auth-test-model-d6c4cc-kserve-5b765f48b7-sslf4"]
Sep 11 18:45:11.908470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:11.908432    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70ed75c3-7982-46ec-9440-57daa12f9f6e" path="/var/lib/kubelet/pods/70ed75c3-7982-46ec-9440-57daa12f9f6e/volumes"
Sep 11 18:45:23.112616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:23.112577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:45:23.212545 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:23.212511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:45:38.546803 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:38.546767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:45:58.035743 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:58.035711    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:45:58.042107 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:58.042086    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:45:58.362522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:45:58.362440    2561 scope.go:117] "RemoveContainer" containerID="55179012283d4a3b213fd9d943bfeeca2f750188175a75a6d1ae9e836096e151"
Sep 11 18:46:14.289141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289102    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-970faa"]
Sep 11 18:46:14.289611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289587    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ed75c3-7982-46ec-9440-57daa12f9f6e" containerName="main"
Sep 11 18:46:14.289611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289600    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ed75c3-7982-46ec-9440-57daa12f9f6e" containerName="main"
Sep 11 18:46:14.289691 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289627    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5199c80-103d-4346-bf22-755a097f941c" containerName="cleanup"
Sep 11 18:46:14.289691 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289632    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5199c80-103d-4346-bf22-755a097f941c" containerName="cleanup"
Sep 11 18:46:14.289755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289703    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="70ed75c3-7982-46ec-9440-57daa12f9f6e" containerName="main"
Sep 11 18:46:14.289755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.289714    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5199c80-103d-4346-bf22-755a097f941c" containerName="cleanup"
Sep 11 18:46:14.293045 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.293017    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:14.295682 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.295657    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t65h9\""
Sep 11 18:46:14.297058 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.297028    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-970faa"]
Sep 11 18:46:14.477888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.477845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnlf7\" (UniqueName: \"kubernetes.io/projected/0323981a-d477-41e4-a278-34aad784c0c7-kube-api-access-jnlf7\") pod \"test-curl-7542-970faa\" (UID: \"0323981a-d477-41e4-a278-34aad784c0c7\") " pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:14.579540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.579437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlf7\" (UniqueName: \"kubernetes.io/projected/0323981a-d477-41e4-a278-34aad784c0c7-kube-api-access-jnlf7\") pod \"test-curl-7542-970faa\" (UID: \"0323981a-d477-41e4-a278-34aad784c0c7\") " pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:14.587621 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.587593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnlf7\" (UniqueName: \"kubernetes.io/projected/0323981a-d477-41e4-a278-34aad784c0c7-kube-api-access-jnlf7\") pod \"test-curl-7542-970faa\" (UID: \"0323981a-d477-41e4-a278-34aad784c0c7\") " pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:14.604573 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.604534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:14.878912 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:14.878884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-970faa"]
Sep 11 18:46:14.880864 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:46:14.880836    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0323981a_d477_41e4_a278_34aad784c0c7.slice/crio-c48f660f13fa21446477832a2cf8c4f30388c8f604bc5b916a25b487e8711680 WatchSource:0}: Error finding container c48f660f13fa21446477832a2cf8c4f30388c8f604bc5b916a25b487e8711680: Status 404 returned error can't find the container with id c48f660f13fa21446477832a2cf8c4f30388c8f604bc5b916a25b487e8711680
Sep 11 18:46:15.724958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:15.724921    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-970faa" event={"ID":"0323981a-d477-41e4-a278-34aad784c0c7","Type":"ContainerStarted","Data":"aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77"}
Sep 11 18:46:15.724958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:15.724964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-970faa" event={"ID":"0323981a-d477-41e4-a278-34aad784c0c7","Type":"ContainerStarted","Data":"c48f660f13fa21446477832a2cf8c4f30388c8f604bc5b916a25b487e8711680"}
Sep 11 18:46:15.742487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:15.742431    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7542-970faa" podStartSLOduration=1.742415266 podStartE2EDuration="1.742415266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:46:15.740156897 +0000 UTC m=+1818.315260366" watchObservedRunningTime="2026-09-11 18:46:15.742415266 +0000 UTC m=+1818.317518734"
Sep 11 18:46:16.316240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.316200    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-970faa"]
Sep 11 18:46:16.319838 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.319808    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-970faa"]
Sep 11 18:46:16.428707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.428617    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-c2a367"]
Sep 11 18:46:16.429094 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.429080    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0323981a-d477-41e4-a278-34aad784c0c7" containerName="test-curl-7542-970faa"
Sep 11 18:46:16.429141 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.429097    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0323981a-d477-41e4-a278-34aad784c0c7" containerName="test-curl-7542-970faa"
Sep 11 18:46:16.429188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.429178    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0323981a-d477-41e4-a278-34aad784c0c7" containerName="test-curl-7542-970faa"
Sep 11 18:46:16.432493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.432475    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:16.438535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.438501    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-c2a367"]
Sep 11 18:46:16.602746 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.602701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5c52\" (UniqueName: \"kubernetes.io/projected/9851aad8-d5e4-4b2f-82b4-24b288695815-kube-api-access-d5c52\") pod \"test-curl-7542-c2a367\" (UID: \"9851aad8-d5e4-4b2f-82b4-24b288695815\") " pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:16.704034 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.703937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5c52\" (UniqueName: \"kubernetes.io/projected/9851aad8-d5e4-4b2f-82b4-24b288695815-kube-api-access-d5c52\") pod \"test-curl-7542-c2a367\" (UID: \"9851aad8-d5e4-4b2f-82b4-24b288695815\") " pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:16.713127 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.713094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5c52\" (UniqueName: \"kubernetes.io/projected/9851aad8-d5e4-4b2f-82b4-24b288695815-kube-api-access-d5c52\") pod \"test-curl-7542-c2a367\" (UID: \"9851aad8-d5e4-4b2f-82b4-24b288695815\") " pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:16.731648 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:16.731612    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7542-970faa" container="test-curl-7542-970faa"
Sep 11 18:46:16.743683 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:16.743649    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:17.019684 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:17.019651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-c2a367"]
Sep 11 18:46:17.021069 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:46:17.021043    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9851aad8_d5e4_4b2f_82b4_24b288695815.slice/crio-04efe34f448aacf987ba637927114794cfef1f7d106e3001ade1c2b8a814b8a0 WatchSource:0}: Error finding container 04efe34f448aacf987ba637927114794cfef1f7d106e3001ade1c2b8a814b8a0: Status 404 returned error can't find the container with id 04efe34f448aacf987ba637927114794cfef1f7d106e3001ade1c2b8a814b8a0
Sep 11 18:46:17.739585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:17.739544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-c2a367" event={"ID":"9851aad8-d5e4-4b2f-82b4-24b288695815","Type":"ContainerStarted","Data":"6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0"}
Sep 11 18:46:17.739585 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:17.739592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-c2a367" event={"ID":"9851aad8-d5e4-4b2f-82b4-24b288695815","Type":"ContainerStarted","Data":"04efe34f448aacf987ba637927114794cfef1f7d106e3001ade1c2b8a814b8a0"}
Sep 11 18:46:17.740090 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:17.739667    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7542-970faa" podUID="0323981a-d477-41e4-a278-34aad784c0c7" containerName="test-curl-7542-970faa" containerID="cri-o://aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77" gracePeriod=2
Sep 11 18:46:17.755123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:17.755076    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7542-c2a367" podStartSLOduration=1.7550614759999998 podStartE2EDuration="1.755061476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:46:17.75389303 +0000 UTC m=+1820.328996497" watchObservedRunningTime="2026-09-11 18:46:17.755061476 +0000 UTC m=+1820.330164943"
Sep 11 18:46:17.755809 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:17.755785    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-970faa\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="0323981a-d477-41e4-a278-34aad784c0c7" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:17.757576 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:17.757553    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-970faa\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="0323981a-d477-41e4-a278-34aad784c0c7" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:17.911867 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:17.911825    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-970faa\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="0323981a-d477-41e4-a278-34aad784c0c7" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:18.323608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:18.323571    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-c2a367"]
Sep 11 18:46:18.328606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:18.328576    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-c2a367"]
Sep 11 18:46:18.745863 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:18.745833    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7542-c2a367" container="test-curl-7542-c2a367"
Sep 11 18:46:19.752273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:19.752242    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7542-c2a367" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" containerName="test-curl-7542-c2a367" containerID="cri-o://6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0" gracePeriod=2
Sep 11 18:46:19.754574 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:19.754546    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-c2a367\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:19.927730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:19.927704    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:19.940896 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:19.940863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnlf7\" (UniqueName: \"kubernetes.io/projected/0323981a-d477-41e4-a278-34aad784c0c7-kube-api-access-jnlf7\") pod \"0323981a-d477-41e4-a278-34aad784c0c7\" (UID: \"0323981a-d477-41e4-a278-34aad784c0c7\") "
Sep 11 18:46:19.942807 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:19.942786    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0323981a-d477-41e4-a278-34aad784c0c7-kube-api-access-jnlf7" (OuterVolumeSpecName: "kube-api-access-jnlf7") pod "0323981a-d477-41e4-a278-34aad784c0c7" (UID: "0323981a-d477-41e4-a278-34aad784c0c7"). InnerVolumeSpecName "kube-api-access-jnlf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:46:20.042154 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.042125    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnlf7\" (UniqueName: \"kubernetes.io/projected/0323981a-d477-41e4-a278-34aad784c0c7-kube-api-access-jnlf7\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:46:20.171658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.171625    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:46:20.271870 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.271838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:46:20.456960 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.456863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:46:20.759222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.759192    2561 generic.go:356] "Generic (PLEG): container finished" podID="0323981a-d477-41e4-a278-34aad784c0c7" containerID="aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77" exitCode=137
Sep 11 18:46:20.759712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.759237    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:20.759712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.759315    2561 scope.go:117] "RemoveContainer" containerID="aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77"
Sep 11 18:46:20.768988 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.768972    2561 scope.go:117] "RemoveContainer" containerID="aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77"
Sep 11 18:46:20.769242 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:20.769223    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77\": container with ID starting with aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77 not found: ID does not exist" containerID="aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77"
Sep 11 18:46:20.769294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:20.769249    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77"} err="failed to get container status \"aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77\": rpc error: code = NotFound desc = could not find container \"aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77\": container with ID starting with aebc81dbbba860a8814a27c77c36f387ebf23933bf830bc90cdfd6bb8d684a77 not found: ID does not exist"
Sep 11 18:46:20.769992 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:20.769967    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-970faa\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="0323981a-d477-41e4-a278-34aad784c0c7" pod="opendatahub/test-curl-7542-970faa"
Sep 11 18:46:21.356077 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:21.356046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:46:21.909777 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:21.909750    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0323981a-d477-41e4-a278-34aad784c0c7" path="/var/lib/kubelet/pods/0323981a-d477-41e4-a278-34aad784c0c7/volumes"
Sep 11 18:46:21.927155 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:21.927133    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:21.962368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:21.962338    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5c52\" (UniqueName: \"kubernetes.io/projected/9851aad8-d5e4-4b2f-82b4-24b288695815-kube-api-access-d5c52\") pod \"9851aad8-d5e4-4b2f-82b4-24b288695815\" (UID: \"9851aad8-d5e4-4b2f-82b4-24b288695815\") "
Sep 11 18:46:21.964368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:21.964347    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9851aad8-d5e4-4b2f-82b4-24b288695815-kube-api-access-d5c52" (OuterVolumeSpecName: "kube-api-access-d5c52") pod "9851aad8-d5e4-4b2f-82b4-24b288695815" (UID: "9851aad8-d5e4-4b2f-82b4-24b288695815"). InnerVolumeSpecName "kube-api-access-d5c52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:46:22.063767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:22.063676    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5c52\" (UniqueName: \"kubernetes.io/projected/9851aad8-d5e4-4b2f-82b4-24b288695815-kube-api-access-d5c52\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:46:22.774202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:22.774163    2561 generic.go:356] "Generic (PLEG): container finished" podID="9851aad8-d5e4-4b2f-82b4-24b288695815" containerID="6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0" exitCode=137
Sep 11 18:46:22.774404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:22.774209    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:22.774404 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:22.774259    2561 scope.go:117] "RemoveContainer" containerID="6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0"
Sep 11 18:46:22.785033 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:22.784894    2561 scope.go:117] "RemoveContainer" containerID="6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0"
Sep 11 18:46:22.785215 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:22.785195    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0\": container with ID starting with 6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0 not found: ID does not exist" containerID="6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0"
Sep 11 18:46:22.785271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:22.785224    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0"} err="failed to get container status \"6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0\": rpc error: code = NotFound desc = could not find container \"6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0\": container with ID starting with 6a45cd265789dc1e179fb5ad479a0d43d51153013e6f287400865c45c9f09be0 not found: ID does not exist"
Sep 11 18:46:22.785461 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:46:22.785436    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-c2a367\" is forbidden: User \"system:node:ip-10-0-138-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-165.ec2.internal' and this object" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" pod="opendatahub/test-curl-7542-c2a367"
Sep 11 18:46:23.908260 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:23.908224    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" path="/var/lib/kubelet/pods/9851aad8-d5e4-4b2f-82b4-24b288695815/volumes"
Sep 11 18:46:28.283547 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:28.283500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:46:52.889448 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:52.889413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:46:57.309848 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:46:57.309807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:24.851119 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:24.851039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:34.772718 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:34.772681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:35.465597 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:35.465567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:35.566583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:35.566533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:35.803451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:35.803418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:36.212949 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:36.212826    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:36.559613 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:36.559572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:36.956628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:36.956531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:38.741626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:38.741593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:39.445606 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:39.445543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:39.544628 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:39.544593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:39.644440 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:39.644396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:40.531910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:40.531874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:41.269592 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:41.269552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:41.368865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:41.368819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:41.705962 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:41.705873    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:41.808139 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:41.808111    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:47:41.926523 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:47:41.926489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:03.289186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:03.289151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:04.662724 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:04.662690    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:04.764470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:04.764431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:05.070472 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.070435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:05.341182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.341107    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"]
Sep 11 18:48:05.341873 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.341855    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" containerName="test-curl-7542-c2a367"
Sep 11 18:48:05.341922 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.341877    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" containerName="test-curl-7542-c2a367"
Sep 11 18:48:05.342001 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.341989    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9851aad8-d5e4-4b2f-82b4-24b288695815" containerName="test-curl-7542-c2a367"
Sep 11 18:48:05.345555 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.345523    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.348165 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.348143    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b01b33-openshift-default-dockercfg-pmtpk\""
Sep 11 18:48:05.362447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.362419    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"]
Sep 11 18:48:05.384449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.384425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:05.491419 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-podinfo\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-token\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4xv8\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-kube-api-access-k4xv8\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-certs\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491604 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba7b84aa-2782-4d18-9f9e-47a434421395-istiod-ca-cert\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-data\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-socket\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-envoy\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.491785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.491764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-credential-socket\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593481 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-credential-socket\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-podinfo\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-token\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593688 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4xv8\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-kube-api-access-k4xv8\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-certs\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba7b84aa-2782-4d18-9f9e-47a434421395-istiod-ca-cert\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-data\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.593872 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-socket\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.594069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-credential-socket\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.594069 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.593928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-envoy\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.594230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.594206    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-certs\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.594332 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.594246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-data\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.594436 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.594407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-socket\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.594646 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.594610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba7b84aa-2782-4d18-9f9e-47a434421395-istiod-ca-cert\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.596437 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.596419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-envoy\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.596588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.596569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-podinfo\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.606532 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.606508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-token\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.606616 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.606508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4xv8\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-kube-api-access-k4xv8\") pod \"e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") " pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.656190 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.656164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:05.761584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.761549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:05.861348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.861254    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:05.948186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.948155    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"]
Sep 11 18:48:05.949826 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:48:05.949797    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7b84aa_2782_4d18_9f9e_47a434421395.slice/crio-6c0028b2d6cb225277de46a09e3e59e3b1d6d9f4f67c6ac31ec7c3b3ee1c17ae WatchSource:0}: Error finding container 6c0028b2d6cb225277de46a09e3e59e3b1d6d9f4f67c6ac31ec7c3b3ee1c17ae: Status 404 returned error can't find the container with id 6c0028b2d6cb225277de46a09e3e59e3b1d6d9f4f67c6ac31ec7c3b3ee1c17ae
Sep 11 18:48:05.952109 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.952076    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:48:05.952188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.952139    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:48:05.952188 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:05.952170    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:48:06.429053 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:06.429014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" event={"ID":"ba7b84aa-2782-4d18-9f9e-47a434421395","Type":"ContainerStarted","Data":"5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"}
Sep 11 18:48:06.429232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:06.429075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" event={"ID":"ba7b84aa-2782-4d18-9f9e-47a434421395","Type":"ContainerStarted","Data":"6c0028b2d6cb225277de46a09e3e59e3b1d6d9f4f67c6ac31ec7c3b3ee1c17ae"}
Sep 11 18:48:06.450077 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:06.450023    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podStartSLOduration=1.4500052 podStartE2EDuration="1.4500052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:06.448653105 +0000 UTC m=+1929.023756572" watchObservedRunningTime="2026-09-11 18:48:06.4500052 +0000 UTC m=+1929.025108669"
Sep 11 18:48:06.656572 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:06.656541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:07.662361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:07.662333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:07.706645 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:07.706611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:08.411546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:08.411509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:08.442484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:08.442451    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:08.443346 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:08.443294    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:08.526907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:08.526877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:08.628969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:08.628932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:09.663527 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:09.663490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:10.442681 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:10.442648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:11.301183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:11.301137    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:11.403152 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:11.403114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:11.523554 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:11.523517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:11.900108 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:11.900076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:11.997240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:11.997203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:27.574706 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:27.574670    2561 generic.go:356] "Generic (PLEG): container finished" podID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerID="5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd" exitCode=0
Sep 11 18:48:27.575136 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:27.574744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" event={"ID":"ba7b84aa-2782-4d18-9f9e-47a434421395","Type":"ContainerDied","Data":"5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"}
Sep 11 18:48:27.575233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:27.575215    2561 scope.go:117] "RemoveContainer" containerID="5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"
Sep 11 18:48:27.576410 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:27.576380    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:48:27.576565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:27.576456    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:48:27.576565 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:27.576490    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:48:28.582897 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:28.582861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" event={"ID":"ba7b84aa-2782-4d18-9f9e-47a434421395","Type":"ContainerStarted","Data":"920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13"}
Sep 11 18:48:28.656973 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:28.656927    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:28.657340 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:28.657038    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 11 18:48:28.657493 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:28.657378    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 11 18:48:29.656974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:29.656921    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 11 18:48:29.657510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:29.657001    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 11 18:48:30.657761 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:30.657708    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 11 18:48:30.658284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:30.657794    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 11 18:48:31.657692 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:31.657647    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 11 18:48:31.657996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:31.657959    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 11 18:48:32.656955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:32.656885    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 11 18:48:32.657186 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:32.656981    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 11 18:48:33.340154 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:33.340118    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:33.668100 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:33.668011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:33.783181 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:33.783141    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:33.783773 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:33.783739    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:33.784910 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:33.784865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:48:34.656223 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:34.656177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:35.345004 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:35.344965    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:36.134729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:36.134698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:36.858221 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:36.858187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:48:38.273537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:38.273507    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wwts9_0e23eb1a-f598-4bdd-9d8e-bd4747435813/payload-processing/0.log"
Sep 11 18:48:43.591202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:48:43.591150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:00.558090 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:00.558059    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:19.603271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:19.603231    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:24.538273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:24.538242    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wwts9_0e23eb1a-f598-4bdd-9d8e-bd4747435813/payload-processing/0.log"
Sep 11 18:49:24.913894 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:24.913803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:25.191911 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.191838    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"]
Sep 11 18:49:25.194766 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.194749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.197391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.197369    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-d12501-openshift-default-dockercfg-r9llr\""
Sep 11 18:49:25.207363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.207338    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"]
Sep 11 18:49:25.228161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.228129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:25.333244 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-podinfo\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-certs\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-credential-socket\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-socket\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-token\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333467 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rf7h\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-kube-api-access-7rf7h\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333804 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-envoy\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.333804 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.333587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-data\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.429663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.429627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:25.434736 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.434715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-envoy\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.434825 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.434769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-data\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.434888 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.434869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-podinfo\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.434941 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.434929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-certs\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.434989 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.434964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-credential-socket\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435048 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435048 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-socket\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435150 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-token\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435150 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rf7h\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-kube-api-access-7rf7h\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435269 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-data\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-certs\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435404    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-credential-socket\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435484 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-socket\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.435733 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.435708    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.437230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.437207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-envoy\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.437383 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.437366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-podinfo\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.446388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.446321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-token\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.446819 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.446798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rf7h\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-kube-api-access-7rf7h\") pod \"e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") " pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.507754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.507721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:25.786837 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.786810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"]
Sep 11 18:49:25.788234 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:49:25.788202    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474ee5ff_1354_4e3c_9af8_8a55b6d70d81.slice/crio-794bcffd4a24c9f9fab2739930c8d39924a77094519d892145d3c093a9a80380 WatchSource:0}: Error finding container 794bcffd4a24c9f9fab2739930c8d39924a77094519d892145d3c093a9a80380: Status 404 returned error can't find the container with id 794bcffd4a24c9f9fab2739930c8d39924a77094519d892145d3c093a9a80380
Sep 11 18:49:25.791202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.791170    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:49:25.791284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.791238    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:49:25.791284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.791270    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:49:25.953293 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.953255    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" event={"ID":"474ee5ff-1354-4e3c-9af8-8a55b6d70d81","Type":"ContainerStarted","Data":"d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"}
Sep 11 18:49:25.953486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.953324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" event={"ID":"474ee5ff-1354-4e3c-9af8-8a55b6d70d81","Type":"ContainerStarted","Data":"794bcffd4a24c9f9fab2739930c8d39924a77094519d892145d3c093a9a80380"}
Sep 11 18:49:25.977449 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:25.977390    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podStartSLOduration=0.977367097 podStartE2EDuration="977.367097ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:25.976994346 +0000 UTC m=+2008.552097826" watchObservedRunningTime="2026-09-11 18:49:25.977367097 +0000 UTC m=+2008.552470567"
Sep 11 18:49:26.508037 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:26.508003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:26.513451 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:26.513425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:26.960575 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:26.960484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:26.961674 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:26.961648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:27.150629 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:27.150588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:27.935668 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:27.935628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:28.032676 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:28.032646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:28.762609 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:28.762570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:29.531882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:29.531840    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:30.181689 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:30.181656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:30.952034 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:30.951996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:31.052584 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:31.052530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:31.194685 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:31.194643    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:31.414252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:31.414220    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:31.522063 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:31.522025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:48.112361 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:48.112295    2561 generic.go:356] "Generic (PLEG): container finished" podID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerID="d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f" exitCode=0
Sep 11 18:49:48.112750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:48.112368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" event={"ID":"474ee5ff-1354-4e3c-9af8-8a55b6d70d81","Type":"ContainerDied","Data":"d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"}
Sep 11 18:49:48.112846 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:48.112830    2561 scope.go:117] "RemoveContainer" containerID="d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"
Sep 11 18:49:48.114088 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:48.114060    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:49:48.114162 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:48.114127    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:49:48.114199 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:48.114158    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 18:49:49.121057 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:49.121024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" event={"ID":"474ee5ff-1354-4e3c-9af8-8a55b6d70d81","Type":"ContainerStarted","Data":"efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507"}
Sep 11 18:49:49.508247 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:49.508209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:49.508514 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:49.508488    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused" start-of-body=
Sep 11 18:49:49.508599 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:49.508551    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused"
Sep 11 18:49:50.509101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:50.509060    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused" start-of-body=
Sep 11 18:49:50.509528 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:50.509121    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused"
Sep 11 18:49:51.508502 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:51.508456    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused" start-of-body=
Sep 11 18:49:51.508729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:51.508527    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused"
Sep 11 18:49:52.508179 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:52.508134    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused" start-of-body=
Sep 11 18:49:52.508679 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:52.508186    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused"
Sep 11 18:49:52.846060 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:52.845970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:53.139974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.139859    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:53.508317 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.508268    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused" start-of-body=
Sep 11 18:49:53.508774 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.508355    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.107:15021/healthz/ready\": dial tcp 10.134.0.107:15021: connect: connection refused"
Sep 11 18:49:53.514868 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.514842    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"]
Sep 11 18:49:53.517707 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.517688    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:53.520686 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.520665    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:49:53.530614 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.530589    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"]
Sep 11 18:49:53.639286 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.639250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887e2fb-1b46-454a-a02f-ead5a37eeea5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6\" (UID: \"c887e2fb-1b46-454a-a02f-ead5a37eeea5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:53.741230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.741190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887e2fb-1b46-454a-a02f-ead5a37eeea5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6\" (UID: \"c887e2fb-1b46-454a-a02f-ead5a37eeea5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:53.741919 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.741892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887e2fb-1b46-454a-a02f-ead5a37eeea5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6\" (UID: \"c887e2fb-1b46-454a-a02f-ead5a37eeea5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:53.830339 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:53.830233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:54.134410 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.134377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"]
Sep 11 18:49:54.135621 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:49:54.135576    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc887e2fb_1b46_454a_a02f_ead5a37eeea5.slice/crio-628edc552bf34506c05f3cfa39db12348ac1eb3e1a2f159535d48dce679ef911 WatchSource:0}: Error finding container 628edc552bf34506c05f3cfa39db12348ac1eb3e1a2f159535d48dce679ef911: Status 404 returned error can't find the container with id 628edc552bf34506c05f3cfa39db12348ac1eb3e1a2f159535d48dce679ef911
Sep 11 18:49:54.142543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.141770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:54.158022 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.157985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6" event={"ID":"c887e2fb-1b46-454a-a02f-ead5a37eeea5","Type":"ContainerStarted","Data":"628edc552bf34506c05f3cfa39db12348ac1eb3e1a2f159535d48dce679ef911"}
Sep 11 18:49:54.512866 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.512826    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:54.513314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.513223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:54.513940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.513921    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:49:54.906658 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:54.906616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:55.173821 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:55.173728    2561 generic.go:356] "Generic (PLEG): container finished" podID="c887e2fb-1b46-454a-a02f-ead5a37eeea5" containerID="9dbbe6b20a130ebf4af57ef20d1b327beedbe56aea49704c5cc079ba57561db4" exitCode=0
Sep 11 18:49:55.173969 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:55.173812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6" event={"ID":"c887e2fb-1b46-454a-a02f-ead5a37eeea5","Type":"ContainerDied","Data":"9dbbe6b20a130ebf4af57ef20d1b327beedbe56aea49704c5cc079ba57561db4"}
Sep 11 18:49:55.632444 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:55.632405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:56.319071 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:56.319043    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:56.332640 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:56.332608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:56.395551 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:56.394781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887e2fb-1b46-454a-a02f-ead5a37eeea5-maas-api-service-ca\") pod \"c887e2fb-1b46-454a-a02f-ead5a37eeea5\" (UID: \"c887e2fb-1b46-454a-a02f-ead5a37eeea5\") "
Sep 11 18:49:56.395760 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:56.395719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c887e2fb-1b46-454a-a02f-ead5a37eeea5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c887e2fb-1b46-454a-a02f-ead5a37eeea5" (UID: "c887e2fb-1b46-454a-a02f-ead5a37eeea5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:49:56.396132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:56.396107    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887e2fb-1b46-454a-a02f-ead5a37eeea5-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:49:57.188831 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:57.188800    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"
Sep 11 18:49:57.189225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:57.188829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6" event={"ID":"c887e2fb-1b46-454a-a02f-ead5a37eeea5","Type":"ContainerDied","Data":"628edc552bf34506c05f3cfa39db12348ac1eb3e1a2f159535d48dce679ef911"}
Sep 11 18:49:57.189225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:57.188885    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="628edc552bf34506c05f3cfa39db12348ac1eb3e1a2f159535d48dce679ef911"
Sep 11 18:49:57.285366 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:57.285277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:57.964801 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:57.964765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:58.433111 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:58.433079    2561 scope.go:117] "RemoveContainer" containerID="370cccb0425198250171ea76fbeeeaabe24ff9d464e9c1f5044dd2f14bd94ea8"
Sep 11 18:49:58.442341 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:58.442318    2561 scope.go:117] "RemoveContainer" containerID="cc765719692d457a80a4aa8694129e8e3d709e3e867d057eaa8b9f14e3ffaffe"
Sep 11 18:49:59.287867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:59.287832    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:59.880675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:59.880632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:49:59.946915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:49:59.946884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:00.014225 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.014187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:00.107785 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.107740    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"]
Sep 11 18:50:00.108237 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.108209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:00.112755 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.112733    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d12501-7pbt6"]
Sep 11 18:50:00.172776 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.172671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:00.463662 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.463576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:00.564348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:00.564291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:01.255430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:01.255389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:01.908620 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:01.908586    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c887e2fb-1b46-454a-a02f-ead5a37eeea5" path="/var/lib/kubelet/pods/c887e2fb-1b46-454a-a02f-ead5a37eeea5/volumes"
Sep 11 18:50:01.951996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:01.951964    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:02.754537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:02.754502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:03.627970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:03.627912    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:06.354970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:06.354900    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:06.455241 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:06.455188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:06.590581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:06.590546    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"]
Sep 11 18:50:06.590816 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:06.590782    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" containerID="cri-o://efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507" gracePeriod=30
Sep 11 18:50:06.608198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:06.608131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:09.516372 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:09.516329    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 11 18:50:09.516822 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:09.516413    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:50:10.115483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.115443    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"]
Sep 11 18:50:10.115928 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.115916    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c887e2fb-1b46-454a-a02f-ead5a37eeea5" containerName="revoke-keys"
Sep 11 18:50:10.115980 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.115931    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c887e2fb-1b46-454a-a02f-ead5a37eeea5" containerName="revoke-keys"
Sep 11 18:50:10.116024 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.116009    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c887e2fb-1b46-454a-a02f-ead5a37eeea5" containerName="revoke-keys"
Sep 11 18:50:10.119407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.119383    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:10.121956 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.121931    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hkr85\""
Sep 11 18:50:10.127947 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.127918    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"]
Sep 11 18:50:10.244355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.244313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5\" (UID: \"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:10.345407 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.345366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5\" (UID: \"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:10.346021 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.345996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5\" (UID: \"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:10.404245 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.404161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:10.433132 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.433101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:10.711206 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:10.711180    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"]
Sep 11 18:50:10.712405 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:50:10.712377    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a623904_cdf3_4f00_a1bc_3d7e1dcd3909.slice/crio-fbfee748d802565a4de9c8ebd3361cf5aa489448db64c8401821275817b24f90 WatchSource:0}: Error finding container fbfee748d802565a4de9c8ebd3361cf5aa489448db64c8401821275817b24f90: Status 404 returned error can't find the container with id fbfee748d802565a4de9c8ebd3361cf5aa489448db64c8401821275817b24f90
Sep 11 18:50:11.068602 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.068571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:11.291219 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.291177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5" event={"ID":"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909","Type":"ContainerStarted","Data":"bdd16dcd54c14f1318099665d1b5760615daffcef603f98eaa0995ce376c93e0"}
Sep 11 18:50:11.291429 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.291246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5" event={"ID":"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909","Type":"ContainerStarted","Data":"fbfee748d802565a4de9c8ebd3361cf5aa489448db64c8401821275817b24f90"}
Sep 11 18:50:11.310413 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.310371    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5" podStartSLOduration=1.310356229 podStartE2EDuration="1.310356229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:11.308453761 +0000 UTC m=+2053.883557231" watchObservedRunningTime="2026-09-11 18:50:11.310356229 +0000 UTC m=+2053.885459697"
Sep 11 18:50:11.856729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.856701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:11.862209 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.862186    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:50:11.963450 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963417    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-socket\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963466    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-podinfo\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istiod-ca-cert\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963633 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-envoy\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963643    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-credential-socket\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rf7h\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-kube-api-access-7rf7h\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963683    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:50:11.963805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-data\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.963805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963738    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-certs\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.964054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-token\") pod \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\" (UID: \"474ee5ff-1354-4e3c-9af8-8a55b6d70d81\") "
Sep 11 18:50:11.964054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.963983    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-data" (OuterVolumeSpecName: "istio-data") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:50:11.964054 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964005    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:50:11.964202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964047    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:50:11.964267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964209    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:11.964267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964231    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:11.964267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964247    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:11.964267 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964262    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:11.964438 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.964227    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:11.965789 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.965767    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:50:11.965955 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.965936    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-token" (OuterVolumeSpecName: "istio-token") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:11.966170 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.966150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:50:11.966232 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:11.966154    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-kube-api-access-7rf7h" (OuterVolumeSpecName: "kube-api-access-7rf7h") pod "474ee5ff-1354-4e3c-9af8-8a55b6d70d81" (UID: "474ee5ff-1354-4e3c-9af8-8a55b6d70d81"). InnerVolumeSpecName "kube-api-access-7rf7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:12.065025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.064994    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:12.065025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.065022    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:12.065025 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.065032    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:12.065228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.065041    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rf7h\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-kube-api-access-7rf7h\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:12.065228 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.065051    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/474ee5ff-1354-4e3c-9af8-8a55b6d70d81-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:12.300904 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.300841    2561 generic.go:356] "Generic (PLEG): container finished" podID="8a623904-cdf3-4f00-a1bc-3d7e1dcd3909" containerID="bdd16dcd54c14f1318099665d1b5760615daffcef603f98eaa0995ce376c93e0" exitCode=0
Sep 11 18:50:12.301116 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.300926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5" event={"ID":"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909","Type":"ContainerDied","Data":"bdd16dcd54c14f1318099665d1b5760615daffcef603f98eaa0995ce376c93e0"}
Sep 11 18:50:12.302992 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.302968    2561 generic.go:356] "Generic (PLEG): container finished" podID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerID="efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507" exitCode=0
Sep 11 18:50:12.303126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.303018    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"
Sep 11 18:50:12.303126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.303050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" event={"ID":"474ee5ff-1354-4e3c-9af8-8a55b6d70d81","Type":"ContainerDied","Data":"efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507"}
Sep 11 18:50:12.303126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.303097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s" event={"ID":"474ee5ff-1354-4e3c-9af8-8a55b6d70d81","Type":"ContainerDied","Data":"794bcffd4a24c9f9fab2739930c8d39924a77094519d892145d3c093a9a80380"}
Sep 11 18:50:12.303126 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.303119    2561 scope.go:117] "RemoveContainer" containerID="efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507"
Sep 11 18:50:12.314762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.314743    2561 scope.go:117] "RemoveContainer" containerID="d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"
Sep 11 18:50:12.324732 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.324713    2561 scope.go:117] "RemoveContainer" containerID="efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507"
Sep 11 18:50:12.325053 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:50:12.325033    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507\": container with ID starting with efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507 not found: ID does not exist" containerID="efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507"
Sep 11 18:50:12.325137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.325065    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507"} err="failed to get container status \"efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507\": rpc error: code = NotFound desc = could not find container \"efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507\": container with ID starting with efa33f888d246d9260756776f4a124890cabacc61e6f1168ef78cf9e860d9507 not found: ID does not exist"
Sep 11 18:50:12.325137 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.325088    2561 scope.go:117] "RemoveContainer" containerID="d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"
Sep 11 18:50:12.325466 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:50:12.325444    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f\": container with ID starting with d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f not found: ID does not exist" containerID="d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"
Sep 11 18:50:12.325539 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.325474    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f"} err="failed to get container status \"d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f\": rpc error: code = NotFound desc = could not find container \"d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f\": container with ID starting with d781e9a41fc6987201fa9a26063acb0b47e9f5b6fa9f537ac775d0d7c48fff9f not found: ID does not exist"
Sep 11 18:50:12.333183 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.333158    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"]
Sep 11 18:50:12.343459 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.343437    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s"]
Sep 11 18:50:12.554907 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:12.554821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:13.347581 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:13.347537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:13.458219 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:13.458195    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:13.579819 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:13.579731    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909-maas-api-service-ca\") pod \"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909\" (UID: \"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909\") "
Sep 11 18:50:13.580073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:13.580052    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a623904-cdf3-4f00-a1bc-3d7e1dcd3909" (UID: "8a623904-cdf3-4f00-a1bc-3d7e1dcd3909"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:13.580166 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:13.580146    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909-maas-api-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:50:13.909101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:13.909023    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" path="/var/lib/kubelet/pods/474ee5ff-1354-4e3c-9af8-8a55b6d70d81/volumes"
Sep 11 18:50:14.021506 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:14.021467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:14.318016 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:14.317980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5" event={"ID":"8a623904-cdf3-4f00-a1bc-3d7e1dcd3909","Type":"ContainerDied","Data":"fbfee748d802565a4de9c8ebd3361cf5aa489448db64c8401821275817b24f90"}
Sep 11 18:50:14.318203 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:14.318028    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbfee748d802565a4de9c8ebd3361cf5aa489448db64c8401821275817b24f90"
Sep 11 18:50:14.318203 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:14.317986    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"
Sep 11 18:50:25.706271 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.706158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:25.774537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.774500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:25.838726 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.838691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:25.906867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.906800    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:25.910334 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.910283    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"]
Sep 11 18:50:25.910486 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.910347    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-461acb-zwpp5"]
Sep 11 18:50:25.980748 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:25.980611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:26.302730 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:26.302692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:26.418952 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:26.418919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:27.062284 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:27.062237    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:27.832247 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:27.832215    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:27.910281 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:27.910243    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a623904-cdf3-4f00-a1bc-3d7e1dcd3909" path="/var/lib/kubelet/pods/8a623904-cdf3-4f00-a1bc-3d7e1dcd3909/volumes"
Sep 11 18:50:28.552500 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:28.552458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:31.350367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:31.350329    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:57.930996 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:57.930949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:50:58.087667 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:58.087638    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:50:58.091367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:50:58.091344    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:51:06.353630 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:06.353599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:07.688591 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:07.688552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:08.628159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:08.628129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:14.237184 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:14.237146    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:14.304835 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:14.304793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:14.521742 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:14.521700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:15.667259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:15.667222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:16.526400 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:16.526361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:17.380130 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:17.380085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:18.027414 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:18.027363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:19.322224 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:19.322184    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:25.511881 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:25.511839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:25.585951 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:25.585907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:25.649470 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:25.649429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:25.716240 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:25.716203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:25.779540 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:25.779461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:26.093408 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:26.093321    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:26.196238 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:26.196201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:26.834915 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:26.834884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:27.530153 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:27.530107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:31.746296 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:31.746256    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:31.803927 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:31.803891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:31.983675 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:31.983637    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"]
Sep 11 18:51:31.983935 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:31.983901    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" containerID="cri-o://920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13" gracePeriod=30
Sep 11 18:51:32.009721 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:32.009690    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:32.626234 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:32.626192    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:33.520487 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:33.520451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:33.786583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:33.786495    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:51:33.786583 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:33.786567    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:51:34.214608 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:34.214521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:35.019713 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:35.019680    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:37.242144 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.242109    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:51:37.362355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-socket\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362355 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362361    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-certs\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362389    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-credential-socket\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362410    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4xv8\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-kube-api-access-k4xv8\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-token\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362499    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba7b84aa-2782-4d18-9f9e-47a434421395-istiod-ca-cert\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362521    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-podinfo\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362563    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-envoy\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362626 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362611    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-data\") pod \"ba7b84aa-2782-4d18-9f9e-47a434421395\" (UID: \"ba7b84aa-2782-4d18-9f9e-47a434421395\") "
Sep 11 18:51:37.362970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362645    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:37.362970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362739    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:37.362970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362754    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:37.362970 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.362957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:37.363147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.363001    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba7b84aa-2782-4d18-9f9e-47a434421395-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:51:37.363147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.363120    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.363147 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.363139    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.363273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.363151    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.363273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.363161    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba7b84aa-2782-4d18-9f9e-47a434421395-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.363273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.363169    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.365379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.365348    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:51:37.365379 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.365363    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:37.365549 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.365363    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:51:37.365549 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.365346    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-kube-api-access-k4xv8" (OuterVolumeSpecName: "kube-api-access-k4xv8") pod "ba7b84aa-2782-4d18-9f9e-47a434421395" (UID: "ba7b84aa-2782-4d18-9f9e-47a434421395"). InnerVolumeSpecName "kube-api-access-k4xv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:51:37.463739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.463696    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.463739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.463729    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.463739 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.463741    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4xv8\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-kube-api-access-k4xv8\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.463992 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.463755    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba7b84aa-2782-4d18-9f9e-47a434421395-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:37.867802 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.867764    2561 generic.go:356] "Generic (PLEG): container finished" podID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerID="920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13" exitCode=0
Sep 11 18:51:37.867984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.867822    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"
Sep 11 18:51:37.867984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.867845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" event={"ID":"ba7b84aa-2782-4d18-9f9e-47a434421395","Type":"ContainerDied","Data":"920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13"}
Sep 11 18:51:37.867984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.867898    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq" event={"ID":"ba7b84aa-2782-4d18-9f9e-47a434421395","Type":"ContainerDied","Data":"6c0028b2d6cb225277de46a09e3e59e3b1d6d9f4f67c6ac31ec7c3b3ee1c17ae"}
Sep 11 18:51:37.867984 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.867922    2561 scope.go:117] "RemoveContainer" containerID="920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13"
Sep 11 18:51:37.879468 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.879441    2561 scope.go:117] "RemoveContainer" containerID="5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"
Sep 11 18:51:37.889115 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.889087    2561 scope.go:117] "RemoveContainer" containerID="920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13"
Sep 11 18:51:37.889457 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:51:37.889436    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13\": container with ID starting with 920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13 not found: ID does not exist" containerID="920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13"
Sep 11 18:51:37.889517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.889468    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13"} err="failed to get container status \"920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13\": rpc error: code = NotFound desc = could not find container \"920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13\": container with ID starting with 920cd50d4c55947080314e71e659f1db1d37cc34e50ef2cdcb0544cfda69ae13 not found: ID does not exist"
Sep 11 18:51:37.889517 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.889487    2561 scope.go:117] "RemoveContainer" containerID="5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"
Sep 11 18:51:37.889790 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:51:37.889763    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd\": container with ID starting with 5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd not found: ID does not exist" containerID="5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"
Sep 11 18:51:37.889844 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.889800    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd"} err="failed to get container status \"5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd\": rpc error: code = NotFound desc = could not find container \"5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd\": container with ID starting with 5306a36e1f117202fa813a79e9e8e718f146109c5bb9cbe7a7fad272b50915dd not found: ID does not exist"
Sep 11 18:51:37.891015 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.890992    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"]
Sep 11 18:51:37.895036 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.895014    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq"]
Sep 11 18:51:37.908524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:37.908498    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" path="/var/lib/kubelet/pods/ba7b84aa-2782-4d18-9f9e-47a434421395/volumes"
Sep 11 18:51:42.931805 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:42.931769    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:42.933455 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:42.933429    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"]
Sep 11 18:51:42.936108 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:42.936083    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-ec9107-29819205-g7rxl"]
Sep 11 18:51:43.032406 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:43.032365    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:43.132463 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:43.132422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:43.240516 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:43.240421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:43.534756 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:43.534726    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:43.649627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:43.649588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:43.908522 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:43.908443    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5199c80-103d-4346-bf22-755a097f941c" path="/var/lib/kubelet/pods/c5199c80-103d-4346-bf22-755a097f941c/volumes"
Sep 11 18:51:44.562959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:44.562922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:49.950339 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:49.950289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:50.011810 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:50.011779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:50.199340 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:50.199242    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"]
Sep 11 18:51:50.199563 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:50.199535    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy" containerID="cri-o://a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888" gracePeriod=30
Sep 11 18:51:50.217427 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:50.217361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:51.339478 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:51.339428    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:52.143543 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:52.143506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:51:55.464518 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.464493    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:51:55.541363 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541332    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-socket\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541381    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-envoy\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541546 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541431    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istiod-ca-cert\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541627 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541499    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-podinfo\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541663 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-credential-socket\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541701 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541680    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rh8x\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-kube-api-access-6rh8x\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541700    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-data\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541740 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:55.541829 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541795    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-certs\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541883 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-token\") pod \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\" (UID: \"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8\") "
Sep 11 18:51:55.541938 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.541903    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:51:55.542091 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542054    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:55.542180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542069    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:55.542180 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542086    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:55.542291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542246    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.542291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542266    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.542291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542281    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.542443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542296    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.542443 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.542329    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.544020 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.543999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:51:55.544123 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.544071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-kube-api-access-6rh8x" (OuterVolumeSpecName: "kube-api-access-6rh8x") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "kube-api-access-6rh8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:51:55.544168 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.544139    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:51:55.544204 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.544172    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" (UID: "cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:51:55.642855 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.642821    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.642855 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.642853    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.643058 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.642865    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rh8x\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-kube-api-access-6rh8x\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.643058 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.642879    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:51:55.986833 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.986795    2561 generic.go:356] "Generic (PLEG): container finished" podID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerID="a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888" exitCode=0
Sep 11 18:51:55.987000 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.986851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"
Sep 11 18:51:55.987000 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.986882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" event={"ID":"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8","Type":"ContainerDied","Data":"a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888"}
Sep 11 18:51:55.987000 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.986940    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2" event={"ID":"cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8","Type":"ContainerDied","Data":"908b946035f7dbcbd47d7abf357554f489541a0df5893c9659e0181bfa1bd9d7"}
Sep 11 18:51:55.987000 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.986964    2561 scope.go:117] "RemoveContainer" containerID="a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888"
Sep 11 18:51:55.997174 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:55.997153    2561 scope.go:117] "RemoveContainer" containerID="3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"
Sep 11 18:51:56.006089 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:56.006061    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"]
Sep 11 18:51:56.007632 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:56.007608    2561 scope.go:117] "RemoveContainer" containerID="a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888"
Sep 11 18:51:56.007966 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:51:56.007946    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888\": container with ID starting with a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888 not found: ID does not exist" containerID="a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888"
Sep 11 18:51:56.008013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:56.007977    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888"} err="failed to get container status \"a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888\": rpc error: code = NotFound desc = could not find container \"a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888\": container with ID starting with a8927690318a81c4067a391c7841d699290b541f19bc28d2cd0f8fef7cc46888 not found: ID does not exist"
Sep 11 18:51:56.008013 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:56.007997    2561 scope.go:117] "RemoveContainer" containerID="3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"
Sep 11 18:51:56.008273 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:51:56.008255    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4\": container with ID starting with 3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4 not found: ID does not exist" containerID="3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"
Sep 11 18:51:56.008368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:56.008281    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4"} err="failed to get container status \"3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4\": rpc error: code = NotFound desc = could not find container \"3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4\": container with ID starting with 3008efeb48c64392d55ddb58e6ef643addbc8fa6da55627d36f5b13da2790dd4 not found: ID does not exist"
Sep 11 18:51:56.009939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:56.009919    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2"]
Sep 11 18:51:57.909958 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:57.909922    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" path="/var/lib/kubelet/pods/cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8/volumes"
Sep 11 18:51:58.487255 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:51:58.487220    2561 scope.go:117] "RemoveContainer" containerID="c466c84bc69b2b5175bbdd1dfcb9a7e4f4902089cdbc74aa39040db5e837f796"
Sep 11 18:52:01.043385 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:01.043346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:01.103418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:01.103385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:01.203742 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:01.203711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:01.274716 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:01.274669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:01.599454 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:01.599410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:01.675504 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:01.675454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:07.624704 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:07.624669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:07.685795 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:07.685751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:07.873065 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:07.873022    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"]
Sep 11 18:52:07.873399 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:07.873372    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy" containerID="cri-o://a22d5b17af4bac9aa7c770fcaefd980a250f055bbf4d108d517bb2cd0bc60ab1" gracePeriod=30
Sep 11 18:52:07.893990 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:07.893907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:52:10.467820 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:10.467779    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55dfcbfd4c-hvcdp"]
Sep 11 18:52:10.468331 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:10.467986    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" podUID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" containerName="manager" containerID="cri-o://2d12b027488c632d79805526142c8f8a1656600651998a2afa5f020e001f72fa" gracePeriod=30
Sep 11 18:52:11.095914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.095879    2561 generic.go:356] "Generic (PLEG): container finished" podID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" containerID="2d12b027488c632d79805526142c8f8a1656600651998a2afa5f020e001f72fa" exitCode=0
Sep 11 18:52:11.096059 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.095951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" event={"ID":"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42","Type":"ContainerDied","Data":"2d12b027488c632d79805526142c8f8a1656600651998a2afa5f020e001f72fa"}
Sep 11 18:52:11.111447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.111406    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" podUID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.55:8081/readyz\": dial tcp 10.134.0.55:8081: connect: connection refused"
Sep 11 18:52:11.217819 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.217789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:52:11.414981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.414887    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-metrics-certs\") pod \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") "
Sep 11 18:52:11.414981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.414962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf8t9\" (UniqueName: \"kubernetes.io/projected/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-kube-api-access-rf8t9\") pod \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") "
Sep 11 18:52:11.414981 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.414979    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert\") pod \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\" (UID: \"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42\") "
Sep 11 18:52:11.417040 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.417005    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-kube-api-access-rf8t9" (OuterVolumeSpecName: "kube-api-access-rf8t9") pod "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" (UID: "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42"). InnerVolumeSpecName "kube-api-access-rf8t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:52:11.417040 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.417010    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" (UID: "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:52:11.417187 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.417069    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" (UID: "e1815f9e-f85a-45b3-9cfb-7b821c1e5d42"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:52:11.515940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.515899    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-metrics-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:11.515940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.515933    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf8t9\" (UniqueName: \"kubernetes.io/projected/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-kube-api-access-rf8t9\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:11.515940 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:11.515944    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42-webhook-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:12.103850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:12.103811    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp"
Sep 11 18:52:12.103850 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:12.103834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dfcbfd4c-hvcdp" event={"ID":"e1815f9e-f85a-45b3-9cfb-7b821c1e5d42","Type":"ContainerDied","Data":"0ad8d0282ae65835fac31e97a88c0a98381f0c530a359e625d49cfe0cf9ef239"}
Sep 11 18:52:12.104073 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:12.103931    2561 scope.go:117] "RemoveContainer" containerID="2d12b027488c632d79805526142c8f8a1656600651998a2afa5f020e001f72fa"
Sep 11 18:52:12.122537 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:12.122507    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55dfcbfd4c-hvcdp"]
Sep 11 18:52:12.128323 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:12.128284    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55dfcbfd4c-hvcdp"]
Sep 11 18:52:13.112047 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.112018    2561 generic.go:356] "Generic (PLEG): container finished" podID="e63a909e-187a-4406-93f7-6fc8bd840000" containerID="a22d5b17af4bac9aa7c770fcaefd980a250f055bbf4d108d517bb2cd0bc60ab1" exitCode=0
Sep 11 18:52:13.112412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.112092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" event={"ID":"e63a909e-187a-4406-93f7-6fc8bd840000","Type":"ContainerDied","Data":"a22d5b17af4bac9aa7c770fcaefd980a250f055bbf4d108d517bb2cd0bc60ab1"}
Sep 11 18:52:13.112412 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.112155    2561 scope.go:117] "RemoveContainer" containerID="99d68ad75805a9a07bd5eea2c8dcf0c78d91df684a765d14ac1ed20561d7add2"
Sep 11 18:52:13.147192 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.147165    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:52:13.229017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.228974    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63a909e-187a-4406-93f7-6fc8bd840000-istiod-ca-cert\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229017 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-envoy\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229047    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d57fr\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-kube-api-access-d57fr\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229068    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-data\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229165    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-certs\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229263 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229209    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-istio-token\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63a909e-187a-4406-93f7-6fc8bd840000-istio-podinfo\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-socket\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229382    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-credential-socket\") pod \"e63a909e-187a-4406-93f7-6fc8bd840000\" (UID: \"e63a909e-187a-4406-93f7-6fc8bd840000\") "
Sep 11 18:52:13.229501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-data" (OuterVolumeSpecName: "istio-data") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:13.229501 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229468    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e63a909e-187a-4406-93f7-6fc8bd840000-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:52:13.229762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229695    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:13.229762 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:13.229884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229773    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:13.229884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229781    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63a909e-187a-4406-93f7-6fc8bd840000-istiod-ca-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.229884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229803    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-data\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.229884 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.229816    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.231652 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.231622    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-kube-api-access-d57fr" (OuterVolumeSpecName: "kube-api-access-d57fr") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "kube-api-access-d57fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:52:13.231767 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.231651    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e63a909e-187a-4406-93f7-6fc8bd840000-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 18:52:13.231817 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.231796    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-istio-token" (OuterVolumeSpecName: "istio-token") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:52:13.231855 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.231806    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e63a909e-187a-4406-93f7-6fc8bd840000" (UID: "e63a909e-187a-4406-93f7-6fc8bd840000"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:13.331149 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.331100    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63a909e-187a-4406-93f7-6fc8bd840000-istio-podinfo\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.331149 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.331147    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-workload-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.331390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.331169    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-credential-socket\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.331390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.331184    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63a909e-187a-4406-93f7-6fc8bd840000-istio-envoy\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.331390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.331197    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d57fr\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-kube-api-access-d57fr\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.331390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.331211    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63a909e-187a-4406-93f7-6fc8bd840000-istio-token\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:52:13.908273 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:13.908237    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" path="/var/lib/kubelet/pods/e1815f9e-f85a-45b3-9cfb-7b821c1e5d42/volumes"
Sep 11 18:52:14.121325 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:14.121277    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"
Sep 11 18:52:14.121325 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:14.121295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn" event={"ID":"e63a909e-187a-4406-93f7-6fc8bd840000","Type":"ContainerDied","Data":"8745ba075de9c88834308b2689a079f73258d5bfb7160326774d61c332059b30"}
Sep 11 18:52:14.121794 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:14.121381    2561 scope.go:117] "RemoveContainer" containerID="a22d5b17af4bac9aa7c770fcaefd980a250f055bbf4d108d517bb2cd0bc60ab1"
Sep 11 18:52:14.155729 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:14.155697    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"]
Sep 11 18:52:14.162338 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:14.162255    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn"]
Sep 11 18:52:15.908760 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:15.908727    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" path="/var/lib/kubelet/pods/e63a909e-187a-4406-93f7-6fc8bd840000/volumes"
Sep 11 18:52:58.231691 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:52:58.231631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:53:34.315797 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:53:34.315708    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:53:35.974686 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:53:35.974657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:53:43.882974 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:53:43.882937    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:53:43.983405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:53:43.983370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:55:08.240553 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:08.240516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:55:30.495939 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:30.495898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:55:30.599003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:30.598965    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:55:58.134885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:58.134853    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:55:58.140052 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:58.140030    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qcpn_c57d88bc-6ee4-4f14-a5c3-801c7b8daf0f/ovn-acl-logging/0.log"
Sep 11 18:55:58.556112 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:58.556078    2561 scope.go:117] "RemoveContainer" containerID="9dbbe6b20a130ebf4af57ef20d1b327beedbe56aea49704c5cc079ba57561db4"
Sep 11 18:55:59.014524 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:59.014489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:55:59.075364 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:55:59.075324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:56:23.845510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:56:23.845425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:56:31.081416 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:56:31.081378    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:56:58.578634 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:56:58.578599    2561 scope.go:117] "RemoveContainer" containerID="bdd16dcd54c14f1318099665d1b5760615daffcef603f98eaa0995ce376c93e0"
Sep 11 18:57:10.610105 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:10.610065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:57:12.008978 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:12.008944    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:57:48.227752 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:48.227711    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"]
Sep 11 18:57:48.228340 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:48.227961    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7" podUID="49549f2f-fa27-4716-a06f-65de6f328976" containerName="maas-api" containerID="cri-o://ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d" gracePeriod=30
Sep 11 18:57:49.471913 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.471885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:57:49.537588 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.537554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49549f2f-fa27-4716-a06f-65de6f328976-openshift-service-ca\") pod \"49549f2f-fa27-4716-a06f-65de6f328976\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") "
Sep 11 18:57:49.537754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.537613    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8px8s\" (UniqueName: \"kubernetes.io/projected/49549f2f-fa27-4716-a06f-65de6f328976-kube-api-access-8px8s\") pod \"49549f2f-fa27-4716-a06f-65de6f328976\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") "
Sep 11 18:57:49.537754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.537637    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs\") pod \"49549f2f-fa27-4716-a06f-65de6f328976\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") "
Sep 11 18:57:49.537754 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.537718    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-maas-api-tls\") pod \"49549f2f-fa27-4716-a06f-65de6f328976\" (UID: \"49549f2f-fa27-4716-a06f-65de6f328976\") "
Sep 11 18:57:49.537927 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.537902    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49549f2f-fa27-4716-a06f-65de6f328976-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "49549f2f-fa27-4716-a06f-65de6f328976" (UID: "49549f2f-fa27-4716-a06f-65de6f328976"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:57:49.538085 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.538069    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49549f2f-fa27-4716-a06f-65de6f328976-openshift-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:57:49.539712 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.539689    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49549f2f-fa27-4716-a06f-65de6f328976-kube-api-access-8px8s" (OuterVolumeSpecName: "kube-api-access-8px8s") pod "49549f2f-fa27-4716-a06f-65de6f328976" (UID: "49549f2f-fa27-4716-a06f-65de6f328976"). InnerVolumeSpecName "kube-api-access-8px8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:57:49.539807 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.539710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "49549f2f-fa27-4716-a06f-65de6f328976" (UID: "49549f2f-fa27-4716-a06f-65de6f328976"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:57:49.539860 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.539810    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "49549f2f-fa27-4716-a06f-65de6f328976" (UID: "49549f2f-fa27-4716-a06f-65de6f328976"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:57:49.639397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.639361    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-maas-api-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:57:49.639397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.639393    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8px8s\" (UniqueName: \"kubernetes.io/projected/49549f2f-fa27-4716-a06f-65de6f328976-kube-api-access-8px8s\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:57:49.639397 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:49.639406    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49549f2f-fa27-4716-a06f-65de6f328976-metrics-certs\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Sep 11 18:57:50.151233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.151156    2561 generic.go:356] "Generic (PLEG): container finished" podID="49549f2f-fa27-4716-a06f-65de6f328976" containerID="ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d" exitCode=0
Sep 11 18:57:50.151233 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.151208    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"
Sep 11 18:57:50.151447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.151233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7" event={"ID":"49549f2f-fa27-4716-a06f-65de6f328976","Type":"ContainerDied","Data":"ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d"}
Sep 11 18:57:50.151447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.151344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7" event={"ID":"49549f2f-fa27-4716-a06f-65de6f328976","Type":"ContainerDied","Data":"11ee4fe68b9529fa92bfc3ad7a30a0993fce28fe796dc390715b1c64a6f07ef4"}
Sep 11 18:57:50.151447 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.151377    2561 scope.go:117] "RemoveContainer" containerID="ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d"
Sep 11 18:57:50.160812 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.160796    2561 scope.go:117] "RemoveContainer" containerID="ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d"
Sep 11 18:57:50.161079 ip-10-0-138-165 kubenswrapper[2561]: E0911 18:57:50.161062    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d\": container with ID starting with ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d not found: ID does not exist" containerID="ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d"
Sep 11 18:57:50.161120 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.161086    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d"} err="failed to get container status \"ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d\": rpc error: code = NotFound desc = could not find container \"ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d\": container with ID starting with ade959aa523c1beadd002e14b57de311081336eae387789972bd87e280d4ec5d not found: ID does not exist"
Sep 11 18:57:50.169348 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.169282    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"]
Sep 11 18:57:50.172865 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:50.172842    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6598bdcc8c-mvqm7"]
Sep 11 18:57:51.907967 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:57:51.907929    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49549f2f-fa27-4716-a06f-65de6f328976" path="/var/lib/kubelet/pods/49549f2f-fa27-4716-a06f-65de6f328976/volumes"
Sep 11 18:58:07.014052 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:07.014024    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8gpx7_6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7/manager/0.log"
Sep 11 18:58:07.369159 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:07.369071    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rsfn4_fb6e8d5e-3d02-4774-9ad0-eddcee4b2943/server/0.log"
Sep 11 18:58:07.490638 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:07.490587    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xq5lv_d2e53fbd-d31d-4e6c-bdad-e78750064e70/manager/0.log"
Sep 11 18:58:07.601611 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:07.601576    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd_1e45ff82-713b-4c61-afc9-1033182f542e/copy-manifests/0.log"
Sep 11 18:58:07.620862 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:07.620785    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd_1e45ff82-713b-4c61-afc9-1033182f542e/manager/0.log"
Sep 11 18:58:08.602424 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:08.602392    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-2nfl9_58faf6a9-5058-46a0-b2af-eda095386e4f/postgres/0.log"
Sep 11 18:58:09.566885 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:09.566845    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-jqq2r_5e079832-0c42-4e5e-8fed-974f8fadeea7/manager/0.log"
Sep 11 18:58:09.669902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:09.669875    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5nzvn_222c0326-956b-44e8-86ac-3e87e6c81e5f/kuadrant-console-plugin/0.log"
Sep 11 18:58:10.348289 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:10.348259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj_161d95f0-b11f-4975-a65c-2a21c4d5df4a/istio-proxy/0.log"
Sep 11 18:58:10.797138 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:10.797108    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/1.log"
Sep 11 18:58:11.031959 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:11.031922    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wwts9_0e23eb1a-f598-4bdd-9d8e-bd4747435813/payload-processing/0.log"
Sep 11 18:58:11.590937 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:11.590905    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fm6qh_fb704224-cfb4-4b9c-bf23-b8ec5ee53425/main/0.log"
Sep 11 18:58:11.817556 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:11.817522    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hrcrq_9398c2d0-4531-4995-87ec-5baa824132e4/main/0.log"
Sep 11 18:58:17.762198 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762161    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r9k92/must-gather-khdpw"]
Sep 11 18:58:17.762595 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762587    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762599    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762612    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762617    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762626    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762632    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762639    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy"
Sep 11 18:58:17.762643 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762645    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762653    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" containerName="manager"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762658    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" containerName="manager"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762666    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762671    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762680    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762685    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762695    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49549f2f-fa27-4716-a06f-65de6f328976" containerName="maas-api"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762700    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="49549f2f-fa27-4716-a06f-65de6f328976" containerName="maas-api"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762707    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762712    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762720    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a623904-cdf3-4f00-a1bc-3d7e1dcd3909" containerName="revoke-keys"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762725    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a623904-cdf3-4f00-a1bc-3d7e1dcd3909" containerName="revoke-keys"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762793    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762801    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762807    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe37e57-b6e1-4b9c-a6e5-668a3b47ced8" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762812    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a623904-cdf3-4f00-a1bc-3d7e1dcd3909" containerName="revoke-keys"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762818    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1815f9e-f85a-45b3-9cfb-7b821c1e5d42" containerName="manager"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762824    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7b84aa-2782-4d18-9f9e-47a434421395" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762829    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762837    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="49549f2f-fa27-4716-a06f-65de6f328976" containerName="maas-api"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762842    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="474ee5ff-1354-4e3c-9af8-8a55b6d70d81" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762847    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762854    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762922    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy"
Sep 11 18:58:17.762931 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.762929    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63a909e-187a-4406-93f7-6fc8bd840000" containerName="istio-proxy"
Sep 11 18:58:17.766192 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.766175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:17.768875 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.768845    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9k92\"/\"kube-root-ca.crt\""
Sep 11 18:58:17.768997 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.768915    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9k92\"/\"openshift-service-ca.crt\""
Sep 11 18:58:17.769963 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.769946    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r9k92\"/\"default-dockercfg-bfrpt\""
Sep 11 18:58:17.780564 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.780544    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9k92/must-gather-khdpw"]
Sep 11 18:58:17.780945 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.780920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:58:17.872933 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.872901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log" limit=1024
Sep 11 18:58:17.898259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.898228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0-must-gather-output\") pod \"must-gather-khdpw\" (UID: \"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0\") " pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:17.898399 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.898360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kb6t\" (UniqueName: \"kubernetes.io/projected/8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0-kube-api-access-7kb6t\") pod \"must-gather-khdpw\" (UID: \"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0\") " pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:17.999418 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.999387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kb6t\" (UniqueName: \"kubernetes.io/projected/8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0-kube-api-access-7kb6t\") pod \"must-gather-khdpw\" (UID: \"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0\") " pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:17.999578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.999459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0-must-gather-output\") pod \"must-gather-khdpw\" (UID: \"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0\") " pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:17.999806 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:17.999784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0-must-gather-output\") pod \"must-gather-khdpw\" (UID: \"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0\") " pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:18.014074 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:18.014014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kb6t\" (UniqueName: \"kubernetes.io/projected/8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0-kube-api-access-7kb6t\") pod \"must-gather-khdpw\" (UID: \"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0\") " pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:18.075799 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:18.075766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9k92/must-gather-khdpw"
Sep 11 18:58:18.349291 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:18.349264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9k92/must-gather-khdpw"]
Sep 11 18:58:18.350945 ip-10-0-138-165 kubenswrapper[2561]: W0911 18:58:18.350915    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8efa4f13_6ff2_4969_bbd2_e6ad34b9c9d0.slice/crio-dc2190256c09a259d509094d3d877d2dc1f6df68acb67e237a3930c02c9c210b WatchSource:0}: Error finding container dc2190256c09a259d509094d3d877d2dc1f6df68acb67e237a3930c02c9c210b: Status 404 returned error can't find the container with id dc2190256c09a259d509094d3d877d2dc1f6df68acb67e237a3930c02c9c210b
Sep 11 18:58:18.352892 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:18.352876    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:58:19.333559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:19.333417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9k92/must-gather-khdpw" event={"ID":"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0","Type":"ContainerStarted","Data":"900a0ecbd0cd5d6f1125a109f3d372e236c1fe300ce77f1168203562eff80663"}
Sep 11 18:58:19.333559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:19.333469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9k92/must-gather-khdpw" event={"ID":"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0","Type":"ContainerStarted","Data":"4cf8f57ae91deec8cd90b8c272d773e17ebb8cd5dd12d127a10bf6e62a7201ce"}
Sep 11 18:58:19.333559 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:19.333487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9k92/must-gather-khdpw" event={"ID":"8efa4f13-6ff2-4969-bbd2-e6ad34b9c9d0","Type":"ContainerStarted","Data":"dc2190256c09a259d509094d3d877d2dc1f6df68acb67e237a3930c02c9c210b"}
Sep 11 18:58:19.356118 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:19.356055    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r9k92/must-gather-khdpw" podStartSLOduration=1.6552958439999998 podStartE2EDuration="2.356033892s" totalImagesPullingTime="700.738048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:58:19.348650466 +0000 UTC m=+2541.923753937" watchObservedRunningTime="2026-09-11 18:58:19.356033892 +0000 UTC m=+2541.931137360"
Sep 11 18:58:20.667673 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:20.667625    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6sbx8_f4586932-39b2-43d4-a6cf-f70b1241d20f/global-pull-secret-syncer/0.log"
Sep 11 18:58:20.803446 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:20.803413    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mk4dq_4bcdb978-2370-4ba7-9b6c-d8d38f6ed080/konnectivity-agent/0.log"
Sep 11 18:58:20.921596 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:20.921488    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-165.ec2.internal_682cd59bf6288105db0a4c896dcf85f6/haproxy/0.log"
Sep 11 18:58:26.080344 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:26.080297    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-jqq2r_5e079832-0c42-4e5e-8fed-974f8fadeea7/manager/0.log"
Sep 11 18:58:26.152143 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:26.152045    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5nzvn_222c0326-956b-44e8-86ac-3e87e6c81e5f/kuadrant-console-plugin/0.log"
Sep 11 18:58:27.891430 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:27.891396    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/alertmanager/0.log"
Sep 11 18:58:27.914882 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:27.914846    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/config-reloader/0.log"
Sep 11 18:58:27.937674 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:27.937639    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/kube-rbac-proxy-web/0.log"
Sep 11 18:58:27.963252 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:27.963123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/kube-rbac-proxy/0.log"
Sep 11 18:58:27.986842 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:27.986813    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/kube-rbac-proxy-metric/0.log"
Sep 11 18:58:28.009532 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.009502    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/prom-label-proxy/0.log"
Sep 11 18:58:28.034983 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.034948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa919ee5-4c25-4678-8adf-e40b6ba51264/init-config-reloader/0.log"
Sep 11 18:58:28.087101 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.087067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-7d9zn_516c07df-f9a7-48a7-8cd4-b992f37bfb44/cluster-monitoring-operator/0.log"
Sep 11 18:58:28.117202 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.117165    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mmmk2_a251c79f-a1f8-4736-8371-37b8f67d8552/kube-state-metrics/0.log"
Sep 11 18:58:28.133787 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.133747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mmmk2_a251c79f-a1f8-4736-8371-37b8f67d8552/kube-rbac-proxy-main/0.log"
Sep 11 18:58:28.156084 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.156052    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mmmk2_a251c79f-a1f8-4736-8371-37b8f67d8552/kube-rbac-proxy-self/0.log"
Sep 11 18:58:28.216230 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.216142    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-5n5wn_a4c52d08-1846-47bc-a459-439362ead21c/monitoring-plugin/0.log"
Sep 11 18:58:28.328367 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.328334    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpbp_d46df4b9-939c-4fcc-92e5-5d1e5a22c60c/node-exporter/0.log"
Sep 11 18:58:28.358002 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.357947    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpbp_d46df4b9-939c-4fcc-92e5-5d1e5a22c60c/kube-rbac-proxy/0.log"
Sep 11 18:58:28.378750 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.378720    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gdpbp_d46df4b9-939c-4fcc-92e5-5d1e5a22c60c/init-textfile/0.log"
Sep 11 18:58:28.476405 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.476290    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-62l5j_08154855-b609-41d7-81cd-c353afd8518c/kube-rbac-proxy-main/0.log"
Sep 11 18:58:28.498814 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.498779    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-62l5j_08154855-b609-41d7-81cd-c353afd8518c/kube-rbac-proxy-self/0.log"
Sep 11 18:58:28.521883 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.521847    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-62l5j_08154855-b609-41d7-81cd-c353afd8518c/openshift-state-metrics/0.log"
Sep 11 18:58:28.736371 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.735344    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gtmqg_ad167720-cf34-47af-bfb4-ff4dcbdd618f/prometheus-operator/0.log"
Sep 11 18:58:28.751905 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.751857    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gtmqg_ad167720-cf34-47af-bfb4-ff4dcbdd618f/kube-rbac-proxy/0.log"
Sep 11 18:58:28.776877 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.776844    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-9t8k6_8133809f-7e9a-41be-979c-034f56afb570/prometheus-operator-admission-webhook/0.log"
Sep 11 18:58:28.811314 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.811265    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fc75994d4-jwjcr_711c62d1-4585-4e20-8624-78f8b0adc1da/telemeter-client/0.log"
Sep 11 18:58:28.832550 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.832517    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fc75994d4-jwjcr_711c62d1-4585-4e20-8624-78f8b0adc1da/reload/0.log"
Sep 11 18:58:28.853191 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:28.853146    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fc75994d4-jwjcr_711c62d1-4585-4e20-8624-78f8b0adc1da/kube-rbac-proxy/0.log"
Sep 11 18:58:30.124934 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.124904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-xjdql_3c465316-3fad-4e66-83ba-a33c18b0b503/networking-console-plugin/0.log"
Sep 11 18:58:30.396283 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.396194    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"]
Sep 11 18:58:30.401703 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.401672    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.408442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.408413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"]
Sep 11 18:58:30.448294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.445061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-sys\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.448294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.445121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-podres\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.448294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.445167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glzj\" (UniqueName: \"kubernetes.io/projected/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-kube-api-access-9glzj\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.448294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.445197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-proc\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.448294 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.445313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-lib-modules\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.546722 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.546672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-lib-modules\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.546914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.546763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-sys\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.546914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.546798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-podres\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.546914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.546839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glzj\" (UniqueName: \"kubernetes.io/projected/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-kube-api-access-9glzj\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.546914 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.546867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-proc\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.547161 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.547021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-proc\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.547221 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.547159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-lib-modules\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.547221 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.547216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-sys\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.547368 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.547295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-podres\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.557420 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.557388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glzj\" (UniqueName: \"kubernetes.io/projected/9d6b34fb-40a7-4ee2-8358-e78b3e8e530f-kube-api-access-9glzj\") pod \"perf-node-gather-daemonset-4wggm\" (UID: \"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f\") " pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:30.717189 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:30.716908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:31.019390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.019359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"]
Sep 11 18:58:31.408222 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.408139    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-96c4f7b6d-d8xth_b456059a-f747-4a14-aad5-48cc46aade2a/console/0.log"
Sep 11 18:58:31.448391 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.448339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm" event={"ID":"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f","Type":"ContainerStarted","Data":"61273ebdada8f8b10fa7e1143a0f655a4bfd65a83e312e46e49b3995e7193ccb"}
Sep 11 18:58:31.448578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.448411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm" event={"ID":"9d6b34fb-40a7-4ee2-8358-e78b3e8e530f","Type":"ContainerStarted","Data":"12950ab089017304d94d4d0450e253e1984b23ccbb21f37f5d68c9235ffc4212"}
Sep 11 18:58:31.448578 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.448460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:31.481954 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.481901    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm" podStartSLOduration=1.481883189 podStartE2EDuration="1.481883189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:58:31.479351709 +0000 UTC m=+2554.054455178" watchObservedRunningTime="2026-09-11 18:58:31.481883189 +0000 UTC m=+2554.056986659"
Sep 11 18:58:31.488654 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:31.488622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-c46db_d14c9b87-4f1c-454b-b9ba-f672d7fde88f/download-server/0.log"
Sep 11 18:58:32.212259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:32.212230    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-f272x_9950d4ec-d924-47f5-939d-298206407d73/volume-data-source-validator/0.log"
Sep 11 18:58:33.385146 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:33.385117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxg7k_dabbd38b-95eb-48b5-b74c-a87f82e02ac7/dns/0.log"
Sep 11 18:58:33.408175 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:33.408131    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxg7k_dabbd38b-95eb-48b5-b74c-a87f82e02ac7/kube-rbac-proxy/0.log"
Sep 11 18:58:33.455442 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:33.455361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c7srq_476947be-d290-49b9-b5c3-65b974645c5c/dns-node-resolver/0.log"
Sep 11 18:58:34.051631 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:34.051597    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-764fdbb777-b6xj5_50895c0c-4b84-42d4-b964-1328e7af6dad/registry/0.log"
Sep 11 18:58:34.074491 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:34.074453    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ml5b_4d432658-3f35-41e4-ab4a-d24fd02d2b59/node-ca/0.log"
Sep 11 18:58:35.047220 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:35.047181    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj_161d95f0-b11f-4975-a65c-2a21c4d5df4a/istio-proxy/0.log"
Sep 11 18:58:35.548857 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:35.548828    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/0.log"
Sep 11 18:58:35.554182 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:35.554120    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/1.log"
Sep 11 18:58:35.627011 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:35.626976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wwts9_0e23eb1a-f598-4bdd-9d8e-bd4747435813/payload-processing/0.log"
Sep 11 18:58:36.527007 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:36.526968    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sghhm_52319ff3-1bb1-4d09-aa44-67ba79a834b3/serve-healthcheck-canary/0.log"
Sep 11 18:58:37.134856 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:37.134824    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpvk7_45631a58-13c6-453e-996c-478b17a551b7/kube-rbac-proxy/0.log"
Sep 11 18:58:37.156902 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:37.156868    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpvk7_45631a58-13c6-453e-996c-478b17a551b7/exporter/0.log"
Sep 11 18:58:37.180390 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:37.180356    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpvk7_45631a58-13c6-453e-996c-478b17a551b7/extractor/0.log"
Sep 11 18:58:37.469788 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:37.469718    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r9k92/perf-node-gather-daemonset-4wggm"
Sep 11 18:58:39.537483 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:39.537442    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8gpx7_6b8ee13a-eb07-44bb-a8a8-e56ce2f196b7/manager/0.log"
Sep 11 18:58:39.872388 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:39.872353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rsfn4_fb6e8d5e-3d02-4774-9ad0-eddcee4b2943/server/0.log"
Sep 11 18:58:40.024156 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:40.024118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xq5lv_d2e53fbd-d31d-4e6c-bdad-e78750064e70/manager/0.log"
Sep 11 18:58:40.145723 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:40.145692    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd_1e45ff82-713b-4c61-afc9-1033182f542e/manager/0.log"
Sep 11 18:58:40.163720 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:40.163690    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f4cbcd7d-lwxrd_1e45ff82-713b-4c61-afc9-1033182f542e/copy-manifests/0.log"
Sep 11 18:58:41.579510 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:41.579449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68f8b56d64-vxl89_5a8e54db-c4fb-4308-93bc-ebb90571256a/manager/0.log"
Sep 11 18:58:41.617698 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:41.617662    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w7jjn_d92aa0b9-08f1-4cf1-89a4-f1e44492f8cc/openshift-lws-operator/0.log"
Sep 11 18:58:41.617933 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:41.617900    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj_161d95f0-b11f-4975-a65c-2a21c4d5df4a/istio-proxy/0.log"
Sep 11 18:58:42.087535 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:42.087497    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/0.log"
Sep 11 18:58:42.096003 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:42.095973    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/1.log"
Sep 11 18:58:42.148280 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:42.148251    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wwts9_0e23eb1a-f598-4bdd-9d8e-bd4747435813/payload-processing/0.log"
Sep 11 18:58:43.613290 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:43.613250    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj_161d95f0-b11f-4975-a65c-2a21c4d5df4a/istio-proxy/0.log"
Sep 11 18:58:44.100867 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:44.100794    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/0.log"
Sep 11 18:58:44.106259 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:44.106233    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-v7wzs_9c153c1e-8d48-48e8-91ca-72007c5f97a6/istio-proxy/1.log"
Sep 11 18:58:44.180268 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:44.180234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wwts9_0e23eb1a-f598-4bdd-9d8e-bd4747435813/payload-processing/0.log"
Sep 11 18:58:47.290199 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:47.290154    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wrqdh_0a7aaf45-091b-4d43-93a5-cbf82c41c08c/kube-storage-version-migrator-operator/1.log"
Sep 11 18:58:47.292022 ip-10-0-138-165 kubenswrapper[2561]: I0911 18:58:47.291991    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wrqdh_0a7aaf45-091b-4d43-93a5-cbf82c41c08c/kube-storage-version-migrator-operator/0.log"