Sep 08 00:32:57.515958 ip-10-0-140-137 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 00:32:57.874031 ip-10-0-140-137 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:32:57.874031 ip-10-0-140-137 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 00:32:57.874031 ip-10-0-140-137 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:32:57.874031 ip-10-0-140-137 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 00:32:57.874031 ip-10-0-140-137 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:32:57.875635 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.875563    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 00:32:57.879975 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.879957    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:32:57.879975 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.879972    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:32:57.879975 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.879977    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:32:57.879975 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.879981    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.879985    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.879994    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880000    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880010    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880014    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880018    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880022    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880025    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880029    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880034    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880038    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880043    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880047    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880051    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880055    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880058    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880062    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:32:57.880210 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880067    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880070    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880075    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880079    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880084    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880088    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880092    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880096    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880100    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880104    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880108    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880112    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880116    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880120    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880124    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880130    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880134    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880140    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880144    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880148    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:32:57.881007 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880152    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880157    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880161    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880165    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880169    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880173    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880177    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880181    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880185    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880189    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880193    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880197    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880201    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880206    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880210    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880214    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880219    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880223    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880227    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:32:57.881863 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880231    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880236    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880240    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880244    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880248    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880253    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880257    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880261    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880265    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880270    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880274    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880278    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880282    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880286    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880290    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880294    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880299    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880306    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880312    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880316    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:32:57.882560 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880323    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880328    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880332    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880339    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880345    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880349    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880354    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880359    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880363    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880367    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880371    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880377    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880381    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880385    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880390    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880394    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880398    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.880402    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881498    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:32:57.883199 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881510    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881519    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881525    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881530    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881535    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881539    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881544    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881548    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881552    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881556    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881561    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881565    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881570    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881574    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881578    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881583    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881587    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881591    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881595    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881599    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:32:57.884045 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881603    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881607    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881611    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881615    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881620    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881624    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881628    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881632    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881636    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881640    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881644    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881648    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881652    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881657    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881661    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881665    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881669    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881673    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881677    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881699    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:32:57.884937 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881703    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881711    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881717    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881722    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881727    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881731    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881736    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881740    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881745    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881750    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881754    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881758    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881762    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881766    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881770    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881775    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881779    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881783    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881786    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:32:57.885559 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881791    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881795    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881799    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881803    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881807    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881811    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881816    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881820    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881824    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881829    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881834    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881838    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881842    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881846    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881850    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881854    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881859    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881863    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881867    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:32:57.886084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881871    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881875    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881879    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881883    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881888    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881892    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881896    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881917    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881923    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881927    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881932    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881936    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881940    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881944    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881949    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881953    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881957    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881961    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881966    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.881970    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:32:57.886614 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883193    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883203    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883208    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883213    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883217    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883221    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883225    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883229    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883233    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883238    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883243    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883247    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883251    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883256    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883260    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883264    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883268    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883271    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883276    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883280    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:32:57.887171 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883284    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883288    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883292    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883297    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883301    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883305    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883309    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883313    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883318    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883322    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883326    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883331    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883343    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883347    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883351    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883355    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883359    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883364    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883368    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:32:57.887818 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883373    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883377    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883381    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883385    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883390    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883398    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883403    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883409    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883413    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883418    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883422    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883426    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883430    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883434    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883438    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883443    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883446    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883453    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883458    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:32:57.888279 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883463    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883468    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883473    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883478    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883482    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883486    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883491    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883496    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883501    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883506    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883510    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883515    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883519    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883525    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883530    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883535    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883539    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883543    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883548    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883552    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:32:57.888869 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883557    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883561    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883564    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883569    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883573    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883577    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883581    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883585    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883589    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883593    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883597    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883601    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883605    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883609    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883613    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883617    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883621    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883625    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883631    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883637    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:32:57.889361 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.883642    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883754    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883801    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883811    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883817    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883823    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883828    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883834    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883840    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883845    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883850    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883857    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883862    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883867    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883872    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883876    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883881    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883886    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883890    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883898    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883903    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883908    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883913    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883918    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 00:32:57.889865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883924    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883929    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883936    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883942    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883947    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883952    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883956    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883961    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883966    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883972    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883977    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883981    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883986    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883991    2578 flags.go:64] FLAG: --enable-server="true"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.883995    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884002    2578 flags.go:64] FLAG: --event-burst="100"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884006    2578 flags.go:64] FLAG: --event-qps="50"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884011    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884016    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884021    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884028    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884033    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884037    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884042    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884046    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 00:32:57.890434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884051    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884055    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884059    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884064    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884068    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884072    2578 flags.go:64] FLAG: --feature-gates=""
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884078    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884083    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884088    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884096    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884100    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884105    2578 flags.go:64] FLAG: --help="false"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884110    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-137.ec2.internal"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884115    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884119    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884124    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884130    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884135    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884140    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884144    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884148    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884153    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884157    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884163    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 00:32:57.891058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884167    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884172    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884176    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884181    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884187    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884191    2578 flags.go:64] FLAG: --lock-file=""
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884195    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884200    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884205    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884213    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884218    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884223    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884227    2578 flags.go:64] FLAG: --logging-format="text"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884231    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884237    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884242    2578 flags.go:64] FLAG: --manifest-url=""
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884246    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884255    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884259    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884265    2578 flags.go:64] FLAG: --max-pods="110"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884270    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884275    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884280    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884285    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884290    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 00:32:57.891735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884295    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884299    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884309    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884314    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884319    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884323    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884328    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884336    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884340    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884345    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884350    2578 flags.go:64] FLAG: --port="10250"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884354    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884360    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ca496d7fc92e9b7"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884365    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884370    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884375    2578 flags.go:64] FLAG: --register-node="true"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884380    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884386    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884390    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884395    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884399    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884405    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884410    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884416    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884423    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 00:32:57.892384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884427    2578 flags.go:64] FLAG: --runonce="false"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884432    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884437    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884442    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884447    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884451    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884456    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884461    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884466    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884470    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884475    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884479    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884484    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884489    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884494    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884498    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884507    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884511    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884516    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884523    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884528    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884532    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884537    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884542    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884547    2578 flags.go:64] FLAG: --v="2"
Sep 08 00:32:57.893013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884553    2578 flags.go:64] FLAG: --version="false"
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884559    2578 flags.go:64] FLAG: --vmodule=""
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884564    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.884569    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884754    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884763    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884770    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884774    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884779    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884783    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884787    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884795    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884801    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884806    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884811    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884815    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884819    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884824    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884828    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884832    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:32:57.893620 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884836    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884840    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884844    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884848    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884852    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884855    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884859    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884864    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884869    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884873    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884877    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884881    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884885    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884889    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884893    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884897    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884901    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884909    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884915    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884919    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:32:57.894122 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884924    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884928    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884932    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884936    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884940    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884944    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884948    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884952    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884955    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884960    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884963    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884967    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884971    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884975    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884979    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884984    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884990    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.884996    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885000    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:32:57.894607 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885004    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885008    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885014    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885018    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885022    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885026    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885031    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885035    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885039    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885043    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885051    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885059    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885064    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885068    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885073    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885077    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885081    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885085    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885089    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:32:57.895081 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885094    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885097    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885102    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885106    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885111    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885115    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885119    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885123    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885127    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885131    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885135    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885139    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885143    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885147    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885151    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885155    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885160    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885164    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885168    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885172    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:32:57.895547 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885176    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885180    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885184    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885189    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.885195    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.886022    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.892982    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.892999    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.893012    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.893020    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893076    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893080    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893084    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893087    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:32:57.896084 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893090    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893094    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893096    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893099    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893102    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893105    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893108    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893110    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893113    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893126    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893130    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893133    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893137    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893140    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893142    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893145    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893148    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893151    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893153    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:32:57.896437 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893156    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893159    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893161    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893164    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893167    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893169    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893179    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893181    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893184    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893187    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893189    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893192    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893195    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893197    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893200    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893203    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893205    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893208    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893210    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893213    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:32:57.896915 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893215    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893218    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893220    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893223    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893226    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893228    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893230    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893233    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893236    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893238    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893241    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893243    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893246    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893248    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893251    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893253    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893255    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893258    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893261    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893271    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:32:57.897413 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893274    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893277    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893279    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893282    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893284    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893288    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893291    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893294    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893297    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893301    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893305    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893307    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893311    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893313    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893316    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893318    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893321    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893323    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893326    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893328    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:32:57.898001 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893331    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893333    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893336    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893338    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893341    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893343    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893346    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893348    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893351    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893353    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893357    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893359    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893367    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893370    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893372    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:32:57.898549 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893375    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.893380    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893543    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893548    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893551    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893555    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893558    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893561    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893564    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893567    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893570    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893572    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893575    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893577    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:32:57.898939 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893580    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893582    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893585    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893587    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893590    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893592    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893595    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893597    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893600    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893602    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893605    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893608    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893610    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893613    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893616    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893618    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893626    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893629    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893632    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893634    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:32:57.899281 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893637    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893639    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893642    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893644    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893647    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893649    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893652    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893654    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893657    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893659    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893662    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893664    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893667    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893669    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893672    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893674    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893677    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893690    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893693    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893695    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:32:57.899786 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893697    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893700    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893702    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893705    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893708    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893711    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893713    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893716    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893719    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893727    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893729    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893732    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893734    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893738    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893741    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893744    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893747    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893749    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893752    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:32:57.900264 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893754    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893757    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893760    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893762    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893765    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893767    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893770    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893772    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893774    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893777    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893780    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893782    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893785    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893787    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893789    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893792    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893795    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893797    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893800    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:32:57.900799 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893804    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893807    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893810    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893813    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893821    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893824    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893826    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893829    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:57.893831    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.893835    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.893952    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.896994    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.897857    2578 server.go:1019] "Starting client certificate rotation"
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.897960    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 00:32:57.901255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.898018    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 00:32:57.901626 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.900528    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 00:32:57.902010 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.901974    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 00:32:57.916157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.916135    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 08 00:32:57.918750 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.918736    2578 log.go:25] "Validated CRI v1 image API"
Sep 08 00:32:57.919615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.919596    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 00:32:57.925887 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.925859    2578 fs.go:135] Filesystem UUIDs: map[0e6f7598-b554-4285-8b23-80d0d4c2751e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94111268-5ef9-4cf9-83fa-095cf227bd6b:/dev/nvme0n1p3]
Sep 08 00:32:57.925967 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.925884    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 00:32:57.930629 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.930508    2578 manager.go:216] Machine: {Timestamp:2026-09-08 00:32:57.930042315 +0000 UTC m=+0.308415738 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099020 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d988ceb5612e2010137b9268538c8 SystemUUID:ec2d988c-eb56-12e2-0101-37b9268538c8 BootID:99f3dcb9-aea2-491a-aff1-c1e458625fda Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:42:5a:6b:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:42:5a:6b:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:2a:86:89:8f:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 00:32:57.930629 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.930620    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 00:32:57.930760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.930697    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 00:32:57.933312 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.933285    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 00:32:57.933459 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.933314    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 00:32:57.934037 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.934026    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 00:32:57.934092 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.934043    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 00:32:57.934092 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.934053    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 00:32:57.934708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.934697    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 00:32:57.935802 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.935790    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 00:32:57.939159 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939145    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 00:32:57.939289 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939278    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 00:32:57.939369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939316    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 00:32:57.939369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939344    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 00:32:57.939369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939362    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 00:32:57.939493 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939375    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 08 00:32:57.939493 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939388    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 00:32:57.939757 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939744    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 00:32:57.939819 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.939767    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 00:32:57.941986 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.941970    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 00:32:57.943910 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.943894    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 00:32:57.943984 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.943932    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 00:32:57.944145 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944131    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 00:32:57.944216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944157    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 00:32:57.944216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944167    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 00:32:57.944216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944174    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 00:32:57.944216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944185    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 00:32:57.944216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944193    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 00:32:57.944602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944592    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 00:32:57.944652 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944618    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 00:32:57.944652 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944629    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 00:32:57.944652 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944637    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 00:32:57.944796 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944657    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 00:32:57.944796 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944670    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 00:32:57.944796 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944718    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 00:32:57.944796 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.944727    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 00:32:57.948314 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.948298    2578 server.go:1268] "Started kubelet"
Sep 08 00:32:57.948400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.948307    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 00:32:57.948497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.948443    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 00:32:57.948548 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.948518    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 00:32:57.948588 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.948347    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 00:32:57.949144 ip-10-0-140-137 systemd[1]: Started Kubernetes Kubelet.
Sep 08 00:32:57.953578 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.953562    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 00:32:57.954643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.954613    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 00:32:57.954934 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.954873    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 00:32:57.955013 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.954977    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 00:32:57.955981 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.955962    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 00:32:57.956719 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.956668    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 00:32:57.958504 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.957568    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-137.ec2.internal.18d331345c071c07  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-137.ec2.internal,UID:ip-10-0-140-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-137.ec2.internal,},FirstTimestamp:2026-09-08 00:32:57.948249095 +0000 UTC m=+0.326622520,LastTimestamp:2026-09-08 00:32:57.948249095 +0000 UTC m=+0.326622520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-137.ec2.internal,}"
Sep 08 00:32:57.959075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.959056    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 00:32:57.959639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.959617    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 00:32:57.959730 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.959708    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:57.960324 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960302    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 00:32:57.960324 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960304    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 00:32:57.960453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960332    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 00:32:57.960453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960412    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 00:32:57.960453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960422    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 00:32:57.960671 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960657    2578 factory.go:153] Registering CRI-O factory
Sep 08 00:32:57.960730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960676    2578 factory.go:223] Registration of the crio container factory successfully
Sep 08 00:32:57.960770 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960736    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 00:32:57.960770 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960743    2578 factory.go:55] Registering systemd factory
Sep 08 00:32:57.960770 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960748    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 08 00:32:57.960770 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960761    2578 factory.go:103] Registering Raw factory
Sep 08 00:32:57.960770 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.960770    2578 manager.go:1196] Started watching for new ooms in manager
Sep 08 00:32:57.961123 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.961112    2578 manager.go:349] Starting recovery of all containers
Sep 08 00:32:57.968966 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.968934    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 00:32:57.972415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.972398    2578 manager.go:354] Recovery completed
Sep 08 00:32:57.977815 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.977801    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:57.979768 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.979749    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 00:32:57.980843 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.980817    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:57.980906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.980857    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:57.980906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.980888    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:57.981499 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.981484    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 00:32:57.981499 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.981500    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 00:32:57.981589 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.981509    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:57.981589 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.981516    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 00:32:57.982676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.982663    2578 policy_none.go:49] "None policy: Start"
Sep 08 00:32:57.982745 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.982716    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 00:32:57.982745 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.982731    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 00:32:57.982849 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.982832    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:57.982896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.982876    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:57.982896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.982892    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:57.983515 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.983451    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-137.ec2.internal.18d331345df87859  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-137.ec2.internal,UID:ip-10-0-140-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-137.ec2.internal,},FirstTimestamp:2026-09-08 00:32:57.980844121 +0000 UTC m=+0.359217561,LastTimestamp:2026-09-08 00:32:57.980844121 +0000 UTC m=+0.359217561,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-137.ec2.internal,}"
Sep 08 00:32:57.983866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.983842    2578 policy_none.go:47] "Start"
Sep 08 00:32:57.996313 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:57.996295    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r2jpg"
Sep 08 00:32:57.997237 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:57.997182    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-137.ec2.internal.18d331345df8c719  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-137.ec2.internal,UID:ip-10-0-140-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-137.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-137.ec2.internal,},FirstTimestamp:2026-09-08 00:32:57.980864281 +0000 UTC m=+0.359237709,LastTimestamp:2026-09-08 00:32:57.980864281 +0000 UTC m=+0.359237709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-137.ec2.internal,}"
Sep 08 00:32:58.005615 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.005549    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-137.ec2.internal.18d331345df93c2c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-137.ec2.internal,UID:ip-10-0-140-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-137.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-137.ec2.internal,},FirstTimestamp:2026-09-08 00:32:57.980894252 +0000 UTC m=+0.359267675,LastTimestamp:2026-09-08 00:32:57.980894252 +0000 UTC m=+0.359267675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-137.ec2.internal,}"
Sep 08 00:32:58.006497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.006479    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r2jpg"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023320    2578 manager.go:337] "Starting Device Plugin manager"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.023357    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023366    2578 server.go:87] "Starting device plugin registration server"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023631    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023642    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023793    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023875    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 00:32:58.024125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.023882    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 00:32:58.024499 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.024371    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 00:32:58.024499 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.024416    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.049520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.049501    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 00:32:58.050577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.050559    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 00:32:58.050648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.050618    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 00:32:58.050648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.050643    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 00:32:58.050768 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.050724    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 00:32:58.052882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.052864    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:32:58.124550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.124486    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:58.125406 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.125388    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:58.125474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.125425    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:58.125474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.125442    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:58.125474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.125468    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.131897 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.131881    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.131968 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.131901    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-137.ec2.internal\": node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.150845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.150823    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"]
Sep 08 00:32:58.150936 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.150890    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:58.152213 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.152196    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:58.152284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.152223    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:58.152284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.152236    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:58.153357 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.153347    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:58.153501 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.153475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.153578 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.153511    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:58.154069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.154052    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:58.154154 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.154079    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:58.154154 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.154092    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:58.154154 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.154149    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:58.154305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.154179    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:58.154305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.154196    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:58.155455 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.155440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.155533 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.155466    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:58.156183 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.156169    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:58.156267 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.156194    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:58.156267 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.156207    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:58.156870 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.156855    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.161978 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.161963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.162062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.161984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.162062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.162000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa92973b9fc245d1f83164656b4e586-config\") pod \"kube-apiserver-proxy-ip-10-0-140-137.ec2.internal\" (UID: \"3aa92973b9fc245d1f83164656b4e586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.180217 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.180201    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-137.ec2.internal\" not found" node="ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.184416 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.184401    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-137.ec2.internal\" not found" node="ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.256913 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.256891    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.262140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.262126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.262190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.262148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.262190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.262165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa92973b9fc245d1f83164656b4e586-config\") pod \"kube-apiserver-proxy-ip-10-0-140-137.ec2.internal\" (UID: \"3aa92973b9fc245d1f83164656b4e586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.262289 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.262202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa92973b9fc245d1f83164656b4e586-config\") pod \"kube-apiserver-proxy-ip-10-0-140-137.ec2.internal\" (UID: \"3aa92973b9fc245d1f83164656b4e586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.262289 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.262236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.262289 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.262250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.357293 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.357268    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.458043 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.457987    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.482549 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.482521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.487485 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.487467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:58.558098 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.558077    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.658590 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.658572    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.759043 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.759002    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.859183 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.859148    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:58.898028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.897992    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 00:32:58.898496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:58.898160    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 00:32:58.959214 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:58.959187    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:59.009091 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.009014    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 00:27:58 +0000 UTC" deadline="2028-04-06 03:09:39.234591935 +0000 UTC"
Sep 08 00:32:59.009091 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.009063    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13826h36m40.225533602s"
Sep 08 00:32:59.040375 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.040355    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:32:59.041501 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.041482    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:32:59.041593 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.041525    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:32:59.041593 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.041538    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:32:59.060200 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:59.060181    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:59.097139 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:59.097106    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf1a5b1f568ae4ec290635c1d4a989f.slice/crio-8546fa8d75686591bd868a1811cc828eadfc7e3a8868a6bef2e605e332002f84 WatchSource:0}: Error finding container 8546fa8d75686591bd868a1811cc828eadfc7e3a8868a6bef2e605e332002f84: Status 404 returned error can't find the container with id 8546fa8d75686591bd868a1811cc828eadfc7e3a8868a6bef2e605e332002f84
Sep 08 00:32:59.097662 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:32:59.097642    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa92973b9fc245d1f83164656b4e586.slice/crio-c9cf9517aeea3c46fd28cf678a46c517bb6ed3d0d29943df69f98a14ba66e577 WatchSource:0}: Error finding container c9cf9517aeea3c46fd28cf678a46c517bb6ed3d0d29943df69f98a14ba66e577: Status 404 returned error can't find the container with id c9cf9517aeea3c46fd28cf678a46c517bb6ed3d0d29943df69f98a14ba66e577
Sep 08 00:32:59.101431 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.101416    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:32:59.162353 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:59.162327    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:59.229124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.229095    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:32:59.262621 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:59.262570    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found"
Sep 08 00:32:59.270591 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.270576    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:32:59.361076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.361046    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:59.373661 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.373644    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 00:32:59.375493 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.375479    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"
Sep 08 00:32:59.384366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.384349    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 00:32:59.512550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.512520    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:32:59.940492 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.940458    2578 apiserver.go:52] "Watching apiserver"
Sep 08 00:32:59.948161 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.948134    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 00:32:59.949124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.949097    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-xs92k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal","openshift-multus/multus-additional-cni-plugins-xf8vf","openshift-multus/multus-vsbld","openshift-network-diagnostics/network-check-target-kc5s5","kube-system/konnectivity-agent-dbzh9","kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f","openshift-multus/network-metrics-daemon-vmfxh","openshift-network-operator/iptables-alerter-dhlk4","openshift-ovn-kubernetes/ovnkube-node-tlcnm","kube-system/global-pull-secret-syncer-d6x5s","openshift-cluster-node-tuning-operator/tuned-b8t87","openshift-dns/node-resolver-lk8hz"]
Sep 08 00:32:59.950791 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.950766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:32:59.951994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.951971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.953153 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.953129    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.954036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.953676    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9h4v\""
Sep 08 00:32:59.954036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.953798    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.954036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.953862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.954246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.954066    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 00:32:59.955150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.954846    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.955150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.954941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hhc5p\""
Sep 08 00:32:59.955150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.954950    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.955150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.955092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.955666 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.955643    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jxjq8\""
Sep 08 00:32:59.955781 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.955726    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.956467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.956102    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 00:32:59.956467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.956226    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.956467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.956315    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 00:32:59.956467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.956355    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 00:32:59.957115 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.956876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:32:59.957115 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:59.956957    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:32:59.957701 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.957431    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 00:32:59.957701 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.957509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qctq4\""
Sep 08 00:32:59.958395 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.958374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:32:59.959463 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.959317    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 00:32:59.959753 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.959710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:32:59.959877 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:59.959782    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:32:59.961285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.960855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 00:32:59.961285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.961139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xzxc5\""
Sep 08 00:32:59.961285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.961278    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 00:32:59.961529 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.961452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:32:59.962788 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.962764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:32:59.964075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.963894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-45sc2\""
Sep 08 00:32:59.964075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.964001    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.964267 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.964225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:32:59.964674 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.964656    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.965046 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.965026    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dnbtz\""
Sep 08 00:32:59.965343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.965311    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.965425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.965369    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 00:32:59.965799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.965643    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.965916 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.965866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.968286    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.968463    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:32:59.968543    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.968569    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.968742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rf2ln\""
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.968903    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.969174    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 00:32:59.969343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.969181    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 00:32:59.969799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.969579    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 00:32:59.969799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.969585    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 00:32:59.969909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.969811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 00:32:59.970680 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:32:59.970784 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/715cf060-57eb-420e-b142-94ce62416a97-host-slash\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:32:59.970784 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-lib-modules\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.970906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-tuned\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.970906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-cni-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.970906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-multus-certs\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.970906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-modprobe-d\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.971121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysconfig\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.971121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysctl-d\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.971121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.970974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-system-cni-dir\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.971121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-k8s-cni-cncf-io\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.971317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:32:59.971317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4m7l\" (UniqueName: \"kubernetes.io/projected/a1563e37-c33b-4f85-af97-fcd3017cd02e-kube-api-access-j4m7l\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:32:59.971317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/715cf060-57eb-420e-b142-94ce62416a97-iptables-alerter-script\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:32:59.971317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9z5z\" (UniqueName: \"kubernetes.io/projected/715cf060-57eb-420e-b142-94ce62416a97-kube-api-access-z9z5z\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:32:59.971317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-sys\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-cni-multus\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtq8\" (UniqueName: \"kubernetes.io/projected/2e336deb-8a67-4a1a-9bec-3d76fb74379f-kube-api-access-tjtq8\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-kubernetes\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-cnibin\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ca305e0-a6c2-49b5-ab68-44e780297f35-cni-binary-copy\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-kubelet\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.971571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-daemon-config\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysctl-conf\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdf74\" (UniqueName: \"kubernetes.io/projected/b1e79070-9c62-4772-9f99-44b958574b5c-kube-api-access-jdf74\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-cni-bin\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.971980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-etc-kubernetes\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pp6v\" (UniqueName: \"kubernetes.io/projected/0ca305e0-a6c2-49b5-ab68-44e780297f35-kube-api-access-2pp6v\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972427 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd2536de-4cb8-43ef-9803-ce2d2480b7c5-konnectivity-ca\") pod \"konnectivity-agent-dbzh9\" (UID: \"bd2536de-4cb8-43ef-9803-ce2d2480b7c5\") " pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:32:59.972427 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-systemd\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.972637 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-var-lib-kubelet\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.972637 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fkxq\" (UniqueName: \"kubernetes.io/projected/bd8d2aec-293d-44f5-8352-f68465a8a1f9-kube-api-access-6fkxq\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.972743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-system-cni-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-cnibin\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-conf-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-host\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.972912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:32:59.972912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-socket-dir-parent\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.972912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e336deb-8a67-4a1a-9bec-3d76fb74379f-hosts-file\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:32:59.972912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e336deb-8a67-4a1a-9bec-3d76fb74379f-tmp-dir\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:32:59.973163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-run\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.973163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd8d2aec-293d-44f5-8352-f68465a8a1f9-tmp\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:32:59.973163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-netns\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.973163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.972996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-hostroot\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:32:59.973163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.973015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd2536de-4cb8-43ef-9803-ce2d2480b7c5-agent-certs\") pod \"konnectivity-agent-dbzh9\" (UID: \"bd2536de-4cb8-43ef-9803-ce2d2480b7c5\") " pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:32:59.974428 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.974178    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 00:32:59.974428 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.974333    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mln59\""
Sep 08 00:32:59.976802 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.976704    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:32:59.998421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:32:59.998398    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kkx8t"
Sep 08 00:33:00.006456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.006427    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kkx8t"
Sep 08 00:33:00.055409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.055367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" event={"ID":"7bf1a5b1f568ae4ec290635c1d4a989f","Type":"ContainerStarted","Data":"8546fa8d75686591bd868a1811cc828eadfc7e3a8868a6bef2e605e332002f84"}
Sep 08 00:33:00.056573 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.056545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" event={"ID":"3aa92973b9fc245d1f83164656b4e586","Type":"ContainerStarted","Data":"c9cf9517aeea3c46fd28cf678a46c517bb6ed3d0d29943df69f98a14ba66e577"}
Sep 08 00:33:00.061008 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.060990    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 00:33:00.073399 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-modprobe-d\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.073506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysconfig\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.073506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysctl-d\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.073506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-system-cni-dir\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4m7l\" (UniqueName: \"kubernetes.io/projected/a1563e37-c33b-4f85-af97-fcd3017cd02e-kube-api-access-j4m7l\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f195f69-0b1a-472a-9ff6-a522a7240933-host\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-run-netns\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073563    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-system-cni-dir\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-modprobe-d\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073604    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysconfig\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-systemd\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysctl-d\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.073692 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9z5z\" (UniqueName: \"kubernetes.io/projected/715cf060-57eb-420e-b142-94ce62416a97-kube-api-access-z9z5z\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-cnibin\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-kubelet\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-cnibin\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-kubelet\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-daemon-config\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f195f69-0b1a-472a-9ff6-a522a7240933-serviceca\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.073999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrndg\" (UniqueName: \"kubernetes.io/projected/8f195f69-0b1a-472a-9ff6-a522a7240933-kube-api-access-qrndg\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.074148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-etc-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-ovn\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysctl-conf\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-cni-bin\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd2536de-4cb8-43ef-9803-ce2d2480b7c5-konnectivity-ca\") pod \"konnectivity-agent-dbzh9\" (UID: \"bd2536de-4cb8-43ef-9803-ce2d2480b7c5\") " pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-sys-fs\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-sysctl-conf\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-var-lib-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovnkube-config\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-cni-bin\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcb104ac-6bd5-48fa-998a-ca4b60684918-kubelet-config\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-daemon-config\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-systemd\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-var-lib-kubelet\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-systemd\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.074598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-system-cni-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-cnibin\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-host\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-var-lib-kubelet\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e336deb-8a67-4a1a-9bec-3d76fb74379f-tmp-dir\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-cnibin\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-host\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-system-cni-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd8d2aec-293d-44f5-8352-f68465a8a1f9-tmp\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-netns\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-etc-selinux\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-netns\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd2536de-4cb8-43ef-9803-ce2d2480b7c5-konnectivity-ca\") pod \"konnectivity-agent-dbzh9\" (UID: \"bd2536de-4cb8-43ef-9803-ce2d2480b7c5\") " pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e336deb-8a67-4a1a-9bec-3d76fb74379f-tmp-dir\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.075381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.074992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-tuned\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-cni-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-multus-certs\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-cni-bin\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-k8s-cni-cncf-io\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-multus-certs\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-cni-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-registration-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.075235    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075240    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-run-k8s-cni-cncf-io\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/715cf060-57eb-420e-b142-94ce62416a97-iptables-alerter-script\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.075364    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:00.575313924 +0000 UTC m=+2.953687345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-sys\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-cni-multus\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtq8\" (UniqueName: \"kubernetes.io/projected/2e336deb-8a67-4a1a-9bec-3d76fb74379f-kube-api-access-tjtq8\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.076353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-host-var-lib-cni-multus\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-kubernetes\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-kubernetes\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ca305e0-a6c2-49b5-ab68-44e780297f35-cni-binary-copy\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-device-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-sys\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-kubelet\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-slash\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/715cf060-57eb-420e-b142-94ce62416a97-iptables-alerter-script\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-node-log\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovnkube-script-lib\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.075976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdf74\" (UniqueName: \"kubernetes.io/projected/b1e79070-9c62-4772-9f99-44b958574b5c-kube-api-access-jdf74\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-etc-kubernetes\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pp6v\" (UniqueName: \"kubernetes.io/projected/0ca305e0-a6c2-49b5-ab68-44e780297f35-kube-api-access-2pp6v\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.077245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-log-socket\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fkxq\" (UniqueName: \"kubernetes.io/projected/bd8d2aec-293d-44f5-8352-f68465a8a1f9-kube-api-access-6fkxq\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-conf-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-socket-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ca305e0-a6c2-49b5-ab68-44e780297f35-cni-binary-copy\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-cni-netd\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-env-overrides\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-socket-dir-parent\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e336deb-8a67-4a1a-9bec-3d76fb74379f-hosts-file\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmm5\" (UniqueName: \"kubernetes.io/projected/ac78c6ed-79dc-49e1-9073-353417b75cdb-kube-api-access-5lmm5\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcb104ac-6bd5-48fa-998a-ca4b60684918-dbus\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-run\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-hostroot\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-etc-kubernetes\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd2536de-4cb8-43ef-9803-ce2d2480b7c5-agent-certs\") pod \"konnectivity-agent-dbzh9\" (UID: \"bd2536de-4cb8-43ef-9803-ce2d2480b7c5\") " pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-systemd-units\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.078068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovn-node-metrics-cert\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/715cf060-57eb-420e-b142-94ce62416a97-host-slash\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-lib-modules\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrkq\" (UniqueName: \"kubernetes.io/projected/99629f08-30c7-4ae6-a4b6-a155eed58414-kube-api-access-nkrkq\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.076662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077014    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-conf-dir\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-hostroot\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e336deb-8a67-4a1a-9bec-3d76fb74379f-hosts-file\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/715cf060-57eb-420e-b142-94ce62416a97-host-slash\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1e79070-9c62-4772-9f99-44b958574b5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1e79070-9c62-4772-9f99-44b958574b5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ca305e0-a6c2-49b5-ab68-44e780297f35-multus-socket-dir-parent\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-run\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.078646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.077727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd8d2aec-293d-44f5-8352-f68465a8a1f9-lib-modules\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.080141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.080118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd8d2aec-293d-44f5-8352-f68465a8a1f9-tmp\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.080231 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.080150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd8d2aec-293d-44f5-8352-f68465a8a1f9-etc-tuned\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.080686 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.080664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd2536de-4cb8-43ef-9803-ce2d2480b7c5-agent-certs\") pod \"konnectivity-agent-dbzh9\" (UID: \"bd2536de-4cb8-43ef-9803-ce2d2480b7c5\") " pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:00.081202 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.081179    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:00.081347 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.081214    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:00.081347 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.081231    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:00.081347 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.081299    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:33:00.581282633 +0000 UTC m=+2.959656064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:00.082595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.082573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9z5z\" (UniqueName: \"kubernetes.io/projected/715cf060-57eb-420e-b142-94ce62416a97-kube-api-access-z9z5z\") pod \"iptables-alerter-dhlk4\" (UID: \"715cf060-57eb-420e-b142-94ce62416a97\") " pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.082859 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.082815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4m7l\" (UniqueName: \"kubernetes.io/projected/a1563e37-c33b-4f85-af97-fcd3017cd02e-kube-api-access-j4m7l\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:00.085151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.085126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdf74\" (UniqueName: \"kubernetes.io/projected/b1e79070-9c62-4772-9f99-44b958574b5c-kube-api-access-jdf74\") pod \"multus-additional-cni-plugins-xf8vf\" (UID: \"b1e79070-9c62-4772-9f99-44b958574b5c\") " pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.086399 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.086372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fkxq\" (UniqueName: \"kubernetes.io/projected/bd8d2aec-293d-44f5-8352-f68465a8a1f9-kube-api-access-6fkxq\") pod \"tuned-b8t87\" (UID: \"bd8d2aec-293d-44f5-8352-f68465a8a1f9\") " pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.086503 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.086415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pp6v\" (UniqueName: \"kubernetes.io/projected/0ca305e0-a6c2-49b5-ab68-44e780297f35-kube-api-access-2pp6v\") pod \"multus-vsbld\" (UID: \"0ca305e0-a6c2-49b5-ab68-44e780297f35\") " pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.086973 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.086949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtq8\" (UniqueName: \"kubernetes.io/projected/2e336deb-8a67-4a1a-9bec-3d76fb74379f-kube-api-access-tjtq8\") pod \"node-resolver-lk8hz\" (UID: \"2e336deb-8a67-4a1a-9bec-3d76fb74379f\") " pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.177734 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-cni-bin\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-registration-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-device-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-kubelet\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-cni-bin\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-slash\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-registration-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.177882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-node-log\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-slash\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovnkube-script-lib\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-node-log\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-kubelet\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-log-socket\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-log-socket\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.177919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-device-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-socket-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-cni-netd\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-env-overrides\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-cni-netd\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmm5\" (UniqueName: \"kubernetes.io/projected/ac78c6ed-79dc-49e1-9073-353417b75cdb-kube-api-access-5lmm5\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcb104ac-6bd5-48fa-998a-ca4b60684918-dbus\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-socket-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-systemd-units\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovn-node-metrics-cert\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-systemd-units\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrkq\" (UniqueName: \"kubernetes.io/projected/99629f08-30c7-4ae6-a4b6-a155eed58414-kube-api-access-nkrkq\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f195f69-0b1a-472a-9ff6-a522a7240933-host\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-run-netns\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcb104ac-6bd5-48fa-998a-ca4b60684918-dbus\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-systemd\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f195f69-0b1a-472a-9ff6-a522a7240933-host\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-systemd\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f195f69-0b1a-472a-9ff6-a522a7240933-serviceca\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrndg\" (UniqueName: \"kubernetes.io/projected/8f195f69-0b1a-472a-9ff6-a522a7240933-kube-api-access-qrndg\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-etc-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-ovn\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-env-overrides\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovnkube-script-lib\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-run-netns\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.178963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-sys-fs\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-run-ovn\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-var-lib-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovnkube-config\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcb104ac-6bd5-48fa-998a-ca4b60684918-kubelet-config\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-sys-fs\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-etc-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-var-lib-openvswitch\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-etc-selinux\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcb104ac-6bd5-48fa-998a-ca4b60684918-kubelet-config\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78c6ed-79dc-49e1-9073-353417b75cdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.178929    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.178985    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:33:00.678968516 +0000 UTC m=+3.057341947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:00.179895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.179047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f195f69-0b1a-472a-9ff6-a522a7240933-serviceca\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.180787 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.178929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99629f08-30c7-4ae6-a4b6-a155eed58414-etc-selinux\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.180787 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.179240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovnkube-config\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.180969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.180945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac78c6ed-79dc-49e1-9073-353417b75cdb-ovn-node-metrics-cert\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.187224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.187196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrkq\" (UniqueName: \"kubernetes.io/projected/99629f08-30c7-4ae6-a4b6-a155eed58414-kube-api-access-nkrkq\") pod \"aws-ebs-csi-driver-node-p8w2f\" (UID: \"99629f08-30c7-4ae6-a4b6-a155eed58414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.188059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.188032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmm5\" (UniqueName: \"kubernetes.io/projected/ac78c6ed-79dc-49e1-9073-353417b75cdb-kube-api-access-5lmm5\") pod \"ovnkube-node-tlcnm\" (UID: \"ac78c6ed-79dc-49e1-9073-353417b75cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.188160 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.188099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrndg\" (UniqueName: \"kubernetes.io/projected/8f195f69-0b1a-472a-9ff6-a522a7240933-kube-api-access-qrndg\") pod \"node-ca-xs92k\" (UID: \"8f195f69-0b1a-472a-9ff6-a522a7240933\") " pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.267187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.267126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhlk4"
Sep 08 00:33:00.277582 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.277560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8t87"
Sep 08 00:33:00.285285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.285259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xf8vf"
Sep 08 00:33:00.293179 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.293154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vsbld"
Sep 08 00:33:00.299892 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.299874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:00.307444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.307420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lk8hz"
Sep 08 00:33:00.315118 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.315099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f"
Sep 08 00:33:00.324911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.324892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xs92k"
Sep 08 00:33:00.331797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.331781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:00.581205 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.581121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:00.581375 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.581265    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:00.581375 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.581357    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:01.581332499 +0000 UTC m=+3.959705916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:00.681928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.681893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:00.682132 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:00.681941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:00.682132 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.682061    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:00.682132 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.682081    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:00.682132 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.682097    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:00.682132 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.682106    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:00.682399 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.682141    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:33:01.682120721 +0000 UTC m=+4.060494150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:00.682399 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:00.682158    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:33:01.682151377 +0000 UTC m=+4.060524790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:01.008528 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.008445    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 00:28:00 +0000 UTC" deadline="2028-05-21 08:33:33.117794198 +0000 UTC"
Sep 08 00:33:01.008528 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.008479    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14912h0m32.109319346s"
Sep 08 00:33:01.034320 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:01.034293    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99629f08_30c7_4ae6_a4b6_a155eed58414.slice/crio-6e495cf2f089be56cf5a02dad97551d0fb7f504fbe29b7d39b89b01828f42b7c WatchSource:0}: Error finding container 6e495cf2f089be56cf5a02dad97551d0fb7f504fbe29b7d39b89b01828f42b7c: Status 404 returned error can't find the container with id 6e495cf2f089be56cf5a02dad97551d0fb7f504fbe29b7d39b89b01828f42b7c
Sep 08 00:33:01.035523 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:01.035485    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715cf060_57eb_420e_b142_94ce62416a97.slice/crio-c63768717071e5281843b299c98ffba091f28b0813157d4db2d9b8fa1edada19 WatchSource:0}: Error finding container c63768717071e5281843b299c98ffba091f28b0813157d4db2d9b8fa1edada19: Status 404 returned error can't find the container with id c63768717071e5281843b299c98ffba091f28b0813157d4db2d9b8fa1edada19
Sep 08 00:33:01.036638 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:01.036605    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e336deb_8a67_4a1a_9bec_3d76fb74379f.slice/crio-9bae0a930871937dd184d44233d15eccc385a27cc889dfc963e38ed57ad06201 WatchSource:0}: Error finding container 9bae0a930871937dd184d44233d15eccc385a27cc889dfc963e38ed57ad06201: Status 404 returned error can't find the container with id 9bae0a930871937dd184d44233d15eccc385a27cc889dfc963e38ed57ad06201
Sep 08 00:33:01.040317 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:01.040283    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8d2aec_293d_44f5_8352_f68465a8a1f9.slice/crio-8e3000f80868f15c7f5ce047743031d4b4330b72fc17ddeced987fb0c279cfb0 WatchSource:0}: Error finding container 8e3000f80868f15c7f5ce047743031d4b4330b72fc17ddeced987fb0c279cfb0: Status 404 returned error can't find the container with id 8e3000f80868f15c7f5ce047743031d4b4330b72fc17ddeced987fb0c279cfb0
Sep 08 00:33:01.042942 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:01.042908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca305e0_a6c2_49b5_ab68_44e780297f35.slice/crio-f0f39e57f01ac5dd815aa49e1aa8c774283ab8e534151a1b936fd2f7de85f90b WatchSource:0}: Error finding container f0f39e57f01ac5dd815aa49e1aa8c774283ab8e534151a1b936fd2f7de85f90b: Status 404 returned error can't find the container with id f0f39e57f01ac5dd815aa49e1aa8c774283ab8e534151a1b936fd2f7de85f90b
Sep 08 00:33:01.050973 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.050948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:01.051207 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.051178    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:01.059877 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.059676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerStarted","Data":"315fe7480e360e2bea1d79e6ee1e1c08efb590c9acfee6a4729437f2d5af3671"}
Sep 08 00:33:01.060924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.060902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8t87" event={"ID":"bd8d2aec-293d-44f5-8352-f68465a8a1f9","Type":"ContainerStarted","Data":"8e3000f80868f15c7f5ce047743031d4b4330b72fc17ddeced987fb0c279cfb0"}
Sep 08 00:33:01.062449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.062426    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lk8hz" event={"ID":"2e336deb-8a67-4a1a-9bec-3d76fb74379f","Type":"ContainerStarted","Data":"9bae0a930871937dd184d44233d15eccc385a27cc889dfc963e38ed57ad06201"}
Sep 08 00:33:01.063758 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.063731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dbzh9" event={"ID":"bd2536de-4cb8-43ef-9803-ce2d2480b7c5","Type":"ContainerStarted","Data":"540fe89cf1d75829c2c0961c5da0977a8f5da1a00337c0ca9e31183db886047b"}
Sep 08 00:33:01.065296 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.065266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xs92k" event={"ID":"8f195f69-0b1a-472a-9ff6-a522a7240933","Type":"ContainerStarted","Data":"e99cb004a4cc90445f88346ef343e641c875b2619d9e233e96a8c49acff25274"}
Sep 08 00:33:01.067177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.067147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"c94d8a274b6a9e8ce6b5655210ed794824d7196b554300bad85a80382fa45f6d"}
Sep 08 00:33:01.068879 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.068854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vsbld" event={"ID":"0ca305e0-a6c2-49b5-ab68-44e780297f35","Type":"ContainerStarted","Data":"f0f39e57f01ac5dd815aa49e1aa8c774283ab8e534151a1b936fd2f7de85f90b"}
Sep 08 00:33:01.070231 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.070209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhlk4" event={"ID":"715cf060-57eb-420e-b142-94ce62416a97","Type":"ContainerStarted","Data":"c63768717071e5281843b299c98ffba091f28b0813157d4db2d9b8fa1edada19"}
Sep 08 00:33:01.074261 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.074242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f" event={"ID":"99629f08-30c7-4ae6-a4b6-a155eed58414","Type":"ContainerStarted","Data":"6e495cf2f089be56cf5a02dad97551d0fb7f504fbe29b7d39b89b01828f42b7c"}
Sep 08 00:33:01.587985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.587850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:01.588147 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.587983    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:01.588147 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.588054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:03.58803414 +0000 UTC m=+5.966407571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:01.689063 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.689017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:01.689223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:01.689079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:01.689298 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.689258    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:01.689298 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.689281    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:01.689298 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.689294    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:01.689448 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.689355    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:33:03.68933483 +0000 UTC m=+6.067708257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:01.689809 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.689789    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:01.689923 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:01.689849    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:33:03.689832183 +0000 UTC m=+6.068205595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:02.008737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.008617    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 00:28:00 +0000 UTC" deadline="2028-03-20 15:37:14.187134618 +0000 UTC"
Sep 08 00:33:02.008737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.008684    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13431h4m12.178455269s"
Sep 08 00:33:02.054788 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.052886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:02.054788 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.052886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:02.054788 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:02.053023    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:02.054788 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:02.053134    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:02.088490 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.088460    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bf1a5b1f568ae4ec290635c1d4a989f" containerID="5ccb08fa05ab8245e07002d442cd45d4830b17d142e7f5d51bef4ac55cb47457" exitCode=0
Sep 08 00:33:02.088619 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.088546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" event={"ID":"7bf1a5b1f568ae4ec290635c1d4a989f","Type":"ContainerDied","Data":"5ccb08fa05ab8245e07002d442cd45d4830b17d142e7f5d51bef4ac55cb47457"}
Sep 08 00:33:02.101786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.101744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" event={"ID":"3aa92973b9fc245d1f83164656b4e586","Type":"ContainerStarted","Data":"5f97fb9dc49d6b54c0c6ae8cbca57cee57e718f69b60bd4231a589e223f30951"}
Sep 08 00:33:02.129903 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:02.129852    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" podStartSLOduration=2.129833098 podStartE2EDuration="2.129833098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:02.129786289 +0000 UTC m=+4.508159727" watchObservedRunningTime="2026-09-08 00:33:02.129833098 +0000 UTC m=+4.508206537"
Sep 08 00:33:03.051494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:03.051415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:03.052134 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.051550    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:03.122542 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:03.122506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" event={"ID":"7bf1a5b1f568ae4ec290635c1d4a989f","Type":"ContainerStarted","Data":"5cb8157564659e866099c8a522731252af953d79b9b7ffb3bbe582b2dfbe272f"}
Sep 08 00:33:03.610123 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:03.610065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:03.610328 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.610225    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:03.610328 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.610294    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:07.610273876 +0000 UTC m=+9.988647296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:03.711132 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:03.711092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:03.711332 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:03.711149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:03.711332 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.711317    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:03.711457 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.711336    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:03.711457 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.711349    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:03.711457 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.711408    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:33:07.711389984 +0000 UTC m=+10.089763404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:03.711842 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.711822    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:03.711936 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:03.711883    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:33:07.711865996 +0000 UTC m=+10.090239410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:04.053786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:04.053690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:04.054235 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:04.053839    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:04.054235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:04.054227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:04.054360 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:04.054337    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:05.051166 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:05.051131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:05.051351 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:05.051268    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:06.053323 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:06.052811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:06.053323 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:06.052950    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:06.053994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:06.053959    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:06.054212 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:06.054091    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:07.051413 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:07.051336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:07.051581 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.051466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:07.645293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:07.645246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:07.645909 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.645436    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:07.645909 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.645512    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:15.645491128 +0000 UTC m=+18.023864555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:07.746176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:07.746220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.746371    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.746389    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.746400    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.746456    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:33:15.746437391 +0000 UTC m=+18.124810819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.746869    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:07.746953 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:07.746919    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:33:15.746905092 +0000 UTC m=+18.125278520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:08.052484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:08.052346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:08.052651 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:08.052471    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:08.052651 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:08.052637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:08.052855 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:08.052809    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:09.051421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:09.051385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:09.051921 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:09.051524    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:10.052488 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:10.051625    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:10.052488 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:10.051786    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:10.053293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:10.052852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:10.053293 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:10.052970    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:11.051034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:11.051005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:11.051188 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:11.051101    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:12.051182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:12.051144    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:12.051653 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:12.051287    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:12.051653 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:12.051343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:12.051653 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:12.051484    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:13.051487 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:13.051458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:13.051882 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:13.051569    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:14.054622 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:14.054536    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:14.055042 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:14.054538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:14.055042 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:14.054657    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:14.055042 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:14.054744    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:15.051354 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:15.051320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:15.051625 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.051439    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:15.707861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:15.707831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:15.708262 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.707954    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:15.708262 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.708006    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:31.707993311 +0000 UTC m=+34.086366723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:15.808848 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:15.808803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:15.808848 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:15.808847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:15.809059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.808901    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:15.809059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.808960    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:15.809059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.808968    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:33:31.808948109 +0000 UTC m=+34.187321540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:15.809059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.808977    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:15.809059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.808992    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:15.809059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:15.809040    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:33:31.809025731 +0000 UTC m=+34.187399159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:16.051298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:16.051273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:16.051465 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:16.051366    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:16.051465 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:16.051392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:16.051465 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:16.051444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:17.051171 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:17.051141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:17.051616 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:17.051239    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:18.051451 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:18.051421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:18.051908 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:18.051523    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:18.051908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:18.051573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:18.051908 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:18.051732    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:19.051221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:19.051194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:19.051390 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:19.051315    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:20.052129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.051772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:20.052623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.051780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:20.052623 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:20.052216    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:20.052623 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:20.052347    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:20.157538 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.157472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vsbld" event={"ID":"0ca305e0-a6c2-49b5-ab68-44e780297f35","Type":"ContainerStarted","Data":"a0955ed6a75e4e184965e266b010cd9a760df5f3ce140ea11df35e900b7a312a"}
Sep 08 00:33:20.159115 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.159092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f" event={"ID":"99629f08-30c7-4ae6-a4b6-a155eed58414","Type":"ContainerStarted","Data":"b2b0ce232e3e26ca69ac853a785c00b26f259d9120c85d05da6621fda0e5e4a9"}
Sep 08 00:33:20.160623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.160599    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1e79070-9c62-4772-9f99-44b958574b5c" containerID="c956070209d8a091036970828db58080d1cacbff40caea90a04ec7aeef77e221" exitCode=0
Sep 08 00:33:20.160716 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.160691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerDied","Data":"c956070209d8a091036970828db58080d1cacbff40caea90a04ec7aeef77e221"}
Sep 08 00:33:20.162296 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.162273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8t87" event={"ID":"bd8d2aec-293d-44f5-8352-f68465a8a1f9","Type":"ContainerStarted","Data":"3a1f6925d9bdc66b99e1f69e0d613a7596d1fd248b8b60e05333020e376ad40e"}
Sep 08 00:33:20.163867 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.163846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lk8hz" event={"ID":"2e336deb-8a67-4a1a-9bec-3d76fb74379f","Type":"ContainerStarted","Data":"88665066496a864520bc56eeeaf1a706edbe5f2c72cea1640b205679453af113"}
Sep 08 00:33:20.165243 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.165223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dbzh9" event={"ID":"bd2536de-4cb8-43ef-9803-ce2d2480b7c5","Type":"ContainerStarted","Data":"cbb26dad92545394489b430a880903e3fc3ea00e68672955f0ebae44c6c70a0b"}
Sep 08 00:33:20.166604 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.166585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xs92k" event={"ID":"8f195f69-0b1a-472a-9ff6-a522a7240933","Type":"ContainerStarted","Data":"75bf2c949a8bf49efc5f720fbf4f770a55581eb66dbe8786379b2491fc76217b"}
Sep 08 00:33:20.169281 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.169263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"81e296402192111ce56543abfb001976a1c86151380c0b036c3183ad7ffe4355"}
Sep 08 00:33:20.169345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.169312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"6e786e914e99b667b34b03f51293349869b9b99b363211ac3f1e63cf65e7858c"}
Sep 08 00:33:20.169345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.169340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"3e962953c27a479cb23b57b42a7acced6b8da5de8d002b8208f38f7073738b3c"}
Sep 08 00:33:20.169421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.169369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"57c259b325e89da68b83818fc027289eaed97dc813ddfc6124c70d8b2cc61a73"}
Sep 08 00:33:20.169421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.169395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"770a0e3a457b96b19e4ff06de6f73b62c3b4260079f47a3fb5f8aacf9f3eb89a"}
Sep 08 00:33:20.169478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.169423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"1d76ede6059a4012e6808f2f55808a630d527776fc9815f029aaba00a66751d4"}
Sep 08 00:33:20.181717 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.181666    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" podStartSLOduration=20.181654228 podStartE2EDuration="20.181654228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:03.139996279 +0000 UTC m=+5.518369715" watchObservedRunningTime="2026-09-08 00:33:20.181654228 +0000 UTC m=+22.560027661"
Sep 08 00:33:20.181908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.181884    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vsbld" podStartSLOduration=2.799486746 podStartE2EDuration="21.181875316s" totalImagesPullingTime="18.38238857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:20.181583824 +0000 UTC m=+22.559957258" watchObservedRunningTime="2026-09-08 00:33:20.181875316 +0000 UTC m=+22.560248760"
Sep 08 00:33:20.240173 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.238174    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xs92k" podStartSLOduration=2.921572589 podStartE2EDuration="21.238154514s" totalImagesPullingTime="18.316581925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:20.206858464 +0000 UTC m=+22.585231896" watchObservedRunningTime="2026-09-08 00:33:20.238154514 +0000 UTC m=+22.616527947"
Sep 08 00:33:20.241252 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.240878    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b8t87" podStartSLOduration=2.919779155 podStartE2EDuration="21.240836133s" totalImagesPullingTime="18.321056978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:20.239356429 +0000 UTC m=+22.617729860" watchObservedRunningTime="2026-09-08 00:33:20.240836133 +0000 UTC m=+22.619209567"
Sep 08 00:33:20.284958 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.284914    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dbzh9" podStartSLOduration=2.972220273 podStartE2EDuration="21.284902794s" totalImagesPullingTime="18.312682521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:20.259416959 +0000 UTC m=+22.637790391" watchObservedRunningTime="2026-09-08 00:33:20.284902794 +0000 UTC m=+22.663276227"
Sep 08 00:33:20.381666 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.381634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:20.472453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.472400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:20.551234 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.551215    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 00:33:20.575028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:20.575006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:21.036833 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.036730    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T00:33:20.551229433Z","UUID":"445d06eb-8556-40c1-ba75-84eb36c8c746","Handler":null,"Name":"","Endpoint":""}
Sep 08 00:33:21.038317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.038299    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 00:33:21.038444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.038328    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 00:33:21.051390 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.051368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:21.051544 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:21.051472    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:21.174194 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.174000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhlk4" event={"ID":"715cf060-57eb-420e-b142-94ce62416a97","Type":"ContainerStarted","Data":"bb97c225c43409dbd0a8286720c5547b66d791026b983edb08907876110f0698"}
Sep 08 00:33:21.176520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.176493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f" event={"ID":"99629f08-30c7-4ae6-a4b6-a155eed58414","Type":"ContainerStarted","Data":"c03c8f2b6e0a55c895c47d81712b67a5a10021bc0ae998d3a3ade473951c6cb8"}
Sep 08 00:33:21.212758 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.212710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lk8hz" podStartSLOduration=3.886586857 podStartE2EDuration="22.212693507s" totalImagesPullingTime="18.32610665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:20.31006455 +0000 UTC m=+22.688437984" watchObservedRunningTime="2026-09-08 00:33:21.212693507 +0000 UTC m=+23.591066930"
Sep 08 00:33:21.520467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.520440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:21.627471 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:21.627441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:22.050979 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.050954    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:22.051087 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:22.051066    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:22.051615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.051276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:22.051615 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:22.051399    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:22.182318 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.182278    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"e3f4f238412123882dd2285db5d1f1da6e36db301b2e2c3d3c8e7563aa918f13"}
Sep 08 00:33:22.184705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.184628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f" event={"ID":"99629f08-30c7-4ae6-a4b6-a155eed58414","Type":"ContainerStarted","Data":"eb70471f9e14790a49a0531b07ac3e68ab8c5f5f5776d0aabbf7fe630c386b59"}
Sep 08 00:33:22.231995 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.231951    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dhlk4" podStartSLOduration=4.900544956 podStartE2EDuration="23.231938468s" totalImagesPullingTime="18.331393512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:21.213408249 +0000 UTC m=+23.591781685" watchObservedRunningTime="2026-09-08 00:33:22.231938468 +0000 UTC m=+24.610311902"
Sep 08 00:33:22.232620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.232588    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8w2f" podStartSLOduration=3.155987101 podStartE2EDuration="23.232577214s" totalImagesPullingTime="20.076590113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:22.230923414 +0000 UTC m=+24.609296847" watchObservedRunningTime="2026-09-08 00:33:22.232577214 +0000 UTC m=+24.610950647"
Sep 08 00:33:22.803838 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:22.803652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:23.050865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:23.050837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:23.051027 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:23.050941    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:24.051334 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:24.051301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:24.051797 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:24.051442    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:24.051797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:24.051492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:24.051797 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:24.051591    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:24.689837 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:24.689815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:24.690396 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:24.690373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:24.869504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:24.869315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:25.050781 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.050757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:25.050882 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:25.050848    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:25.192520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.192488    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1e79070-9c62-4772-9f99-44b958574b5c" containerID="9f90b32c7b4f5c28d4118e2d514eb71781ada0cd0b8d988d4e4a4872a79288ce" exitCode=0
Sep 08 00:33:25.192917 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.192573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerDied","Data":"9f90b32c7b4f5c28d4118e2d514eb71781ada0cd0b8d988d4e4a4872a79288ce"}
Sep 08 00:33:25.196390 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.196365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" event={"ID":"ac78c6ed-79dc-49e1-9073-353417b75cdb","Type":"ContainerStarted","Data":"16d7ef84cf6382e25dd4eda9081f66acbc9b7a8cd45dd9256333886c8aa49f4d"}
Sep 08 00:33:25.196584 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.196563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:25.197026 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.197005    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dbzh9"
Sep 08 00:33:25.287936 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.287896    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm" podStartSLOduration=7.911323428 podStartE2EDuration="26.287884635s" totalImagesPullingTime="18.376561207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:25.287778074 +0000 UTC m=+27.666151507" watchObservedRunningTime="2026-09-08 00:33:25.287884635 +0000 UTC m=+27.666258068"
Sep 08 00:33:25.339304 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:25.339239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:26.050934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.050901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:26.051129 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:26.051038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:26.051129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.051065    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:26.051239 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:26.051190    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:26.198898 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.198868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:26.199388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.199281    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:26.199388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.199347    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:26.213031 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.213008    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:26.213293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.213277    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:26.717161 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.717124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kc5s5"]
Sep 08 00:33:26.717283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.717262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:26.717360 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:26.717339    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:26.721310 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.721274    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d6x5s"]
Sep 08 00:33:26.721447 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.721397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:26.721541 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:26.721516    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:26.721923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.721901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vmfxh"]
Sep 08 00:33:26.722019 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:26.721997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:26.722116 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:26.722099    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:27.203506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:27.203473    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1e79070-9c62-4772-9f99-44b958574b5c" containerID="cc31f95fedd6ae06f5ccbdb13d2ac39227e355f22df522ad27c70b13552ccbce" exitCode=0
Sep 08 00:33:27.204248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:27.203565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerDied","Data":"cc31f95fedd6ae06f5ccbdb13d2ac39227e355f22df522ad27c70b13552ccbce"}
Sep 08 00:33:28.052457 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:28.052283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:28.052555 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:28.052347    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:28.052555 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:28.052534    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:28.052624 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:28.052603    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:28.208478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:28.208448    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1e79070-9c62-4772-9f99-44b958574b5c" containerID="4345e9c60fc22bb3e91fd0a0923dddf68473143107ce976f7e3ff119777bf470" exitCode=0
Sep 08 00:33:28.208853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:28.208509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerDied","Data":"4345e9c60fc22bb3e91fd0a0923dddf68473143107ce976f7e3ff119777bf470"}
Sep 08 00:33:29.051730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:29.051702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:29.051870 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:29.051804    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:29.230434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:29.230389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:29.331460 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:29.331369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:30.051820 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:30.051788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:30.052011 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:30.051788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:30.052011 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:30.051967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:30.052134 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:30.052107    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:30.166807 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:30.166747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:30.232121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:30.232086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:31.050923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:31.050893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:31.051118 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.051050    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc5s5" podUID="29ca20cd-6d25-41d3-9cd8-b69e60dd62db"
Sep 08 00:33:31.735636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:31.733229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:31.735636 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.733384    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:31.735636 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.733465    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:03.733443504 +0000 UTC m=+66.111816941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:33:31.834171 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:31.834142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:31.834321 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:31.834179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:31.834321 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.834299    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:31.834431 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.834393    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret podName:bcb104ac-6bd5-48fa-998a-ca4b60684918 nodeName:}" failed. No retries permitted until 2026-09-08 00:34:03.834378024 +0000 UTC m=+66.212751441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret") pod "global-pull-secret-syncer-d6x5s" (UID: "bcb104ac-6bd5-48fa-998a-ca4b60684918") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:33:31.834431 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.834304    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:33:31.834431 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.834427    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:33:31.834581 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.834444    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8dcdg for pod openshift-network-diagnostics/network-check-target-kc5s5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:31.834581 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:31.834522    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg podName:29ca20cd-6d25-41d3-9cd8-b69e60dd62db nodeName:}" failed. No retries permitted until 2026-09-08 00:34:03.83450431 +0000 UTC m=+66.212877722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dcdg" (UniqueName: "kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg") pod "network-check-target-kc5s5" (UID: "29ca20cd-6d25-41d3-9cd8-b69e60dd62db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:33:32.051095 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.051070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:32.051201 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:32.051180    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmfxh" podUID="a1563e37-c33b-4f85-af97-fcd3017cd02e"
Sep 08 00:33:32.051306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.051284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:32.051424 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:32.051402    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d6x5s" podUID="bcb104ac-6bd5-48fa-998a-ca4b60684918"
Sep 08 00:33:32.485047 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.485013    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeReady"
Sep 08 00:33:32.485206 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.485136    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 00:33:32.546742 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.546715    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zkkwj"]
Sep 08 00:33:32.578665 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.578639    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tjn4t"]
Sep 08 00:33:32.578816 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.578763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.582168 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.582149    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 00:33:32.582730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.582706    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 00:33:32.582826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.582708    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bs5xs\""
Sep 08 00:33:32.593213 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.593194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkkwj"]
Sep 08 00:33:32.593315 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.593249    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tjn4t"]
Sep 08 00:33:32.593315 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.593263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.596846 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.596827    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2f7c4\""
Sep 08 00:33:32.596943 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.596842    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 00:33:32.597104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.597089    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 00:33:32.597158 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.597103    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 00:33:32.685320 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.685276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:32.741303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.741159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.741303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.741227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce714838-8311-4acb-8929-bc569891295a-cert\") pod \"ingress-canary-tjn4t\" (UID: \"ce714838-8311-4acb-8929-bc569891295a\") " pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.741303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.741296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8r6n\" (UniqueName: \"kubernetes.io/projected/ce714838-8311-4acb-8929-bc569891295a-kube-api-access-x8r6n\") pod \"ingress-canary-tjn4t\" (UID: \"ce714838-8311-4acb-8929-bc569891295a\") " pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.741863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.741325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lldd\" (UniqueName: \"kubernetes.io/projected/8dd25b20-51e3-4402-a5c6-7697c70d628c-kube-api-access-4lldd\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.741863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.741361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd25b20-51e3-4402-a5c6-7697c70d628c-config-volume\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.741863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.741380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dd25b20-51e3-4402-a5c6-7697c70d628c-tmp-dir\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.742341 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.742292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:32.842556 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.842519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.842747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.842581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce714838-8311-4acb-8929-bc569891295a-cert\") pod \"ingress-canary-tjn4t\" (UID: \"ce714838-8311-4acb-8929-bc569891295a\") " pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.842747 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:32.842632    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:33:32.842747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.842641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8r6n\" (UniqueName: \"kubernetes.io/projected/ce714838-8311-4acb-8929-bc569891295a-kube-api-access-x8r6n\") pod \"ingress-canary-tjn4t\" (UID: \"ce714838-8311-4acb-8929-bc569891295a\") " pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.842747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.842668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lldd\" (UniqueName: \"kubernetes.io/projected/8dd25b20-51e3-4402-a5c6-7697c70d628c-kube-api-access-4lldd\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.842747 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:32.842712    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:33:33.342674978 +0000 UTC m=+35.721048409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:33:32.842747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.842744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd25b20-51e3-4402-a5c6-7697c70d628c-config-volume\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.843046 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.842760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dd25b20-51e3-4402-a5c6-7697c70d628c-tmp-dir\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.843121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.843092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dd25b20-51e3-4402-a5c6-7697c70d628c-tmp-dir\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.843381 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.843363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd25b20-51e3-4402-a5c6-7697c70d628c-config-volume\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.847378 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.847358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce714838-8311-4acb-8929-bc569891295a-cert\") pod \"ingress-canary-tjn4t\" (UID: \"ce714838-8311-4acb-8929-bc569891295a\") " pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.852400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.852374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lldd\" (UniqueName: \"kubernetes.io/projected/8dd25b20-51e3-4402-a5c6-7697c70d628c-kube-api-access-4lldd\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:32.852509 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.852462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8r6n\" (UniqueName: \"kubernetes.io/projected/ce714838-8311-4acb-8929-bc569891295a-kube-api-access-x8r6n\") pod \"ingress-canary-tjn4t\" (UID: \"ce714838-8311-4acb-8929-bc569891295a\") " pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:32.902476 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:32.902444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tjn4t"
Sep 08 00:33:33.051636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:33.051606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:33:33.054639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:33.054516    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 00:33:33.054639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:33.054530    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 00:33:33.054639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:33.054577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wspvj\""
Sep 08 00:33:33.348007 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:33.347928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:33.348142 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:33.348100    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:33:33.348201 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:33.348172    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:33:34.348151412 +0000 UTC m=+36.726524829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:33:33.964696 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:33.964557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tjn4t"]
Sep 08 00:33:33.967215 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:33.967180    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce714838_8311_4acb_8929_bc569891295a.slice/crio-3161ac83dfbdc3a659aa968ac0d0c80ec1bdba44a10cc25a3d861d6764b2a6c4 WatchSource:0}: Error finding container 3161ac83dfbdc3a659aa968ac0d0c80ec1bdba44a10cc25a3d861d6764b2a6c4: Status 404 returned error can't find the container with id 3161ac83dfbdc3a659aa968ac0d0c80ec1bdba44a10cc25a3d861d6764b2a6c4
Sep 08 00:33:34.051107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.051071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:33:34.051321 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.051298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:33:34.054582 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.054301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 00:33:34.054582 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.054483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 00:33:34.056702 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.055277    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5xvx4\""
Sep 08 00:33:34.224957 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.224894    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1e79070-9c62-4772-9f99-44b958574b5c" containerID="b879ab62589027f1cee15a2c0448c264db142e5c7f83f1918ce4a0180599089f" exitCode=0
Sep 08 00:33:34.225065 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.224978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerDied","Data":"b879ab62589027f1cee15a2c0448c264db142e5c7f83f1918ce4a0180599089f"}
Sep 08 00:33:34.226093 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.226074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tjn4t" event={"ID":"ce714838-8311-4acb-8929-bc569891295a","Type":"ContainerStarted","Data":"3161ac83dfbdc3a659aa968ac0d0c80ec1bdba44a10cc25a3d861d6764b2a6c4"}
Sep 08 00:33:34.356435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:34.356403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:34.356541 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:34.356525    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:33:34.356601 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:34.356571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:33:36.356558621 +0000 UTC m=+38.734932031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:33:35.231949 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:35.231910    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1e79070-9c62-4772-9f99-44b958574b5c" containerID="fc5be193b3e8586876b4c1b3a74ab1828c8de5db8fa900b583ce2298efcffe21" exitCode=0
Sep 08 00:33:35.232566 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:35.231946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerDied","Data":"fc5be193b3e8586876b4c1b3a74ab1828c8de5db8fa900b583ce2298efcffe21"}
Sep 08 00:33:36.241338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:36.241302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" event={"ID":"b1e79070-9c62-4772-9f99-44b958574b5c","Type":"ContainerStarted","Data":"f63ba52788801aa5274134193b90c82c2e0b8d63492a6bc80505b7e233d90d4a"}
Sep 08 00:33:36.268498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:36.268437    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xf8vf" podStartSLOduration=6.989083179 podStartE2EDuration="37.268416695s" totalImagesPullingTime="30.279333516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:36.267062825 +0000 UTC m=+38.645436284" watchObservedRunningTime="2026-09-08 00:33:36.268416695 +0000 UTC m=+38.646790130"
Sep 08 00:33:36.369109 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:36.369079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:36.369233 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:36.369219    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:33:36.369289 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:36.369279    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:33:40.369262094 +0000 UTC m=+42.747635521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:33:36.416041 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:36.416014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:36.513868 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:36.513812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:37.248478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:37.248244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tjn4t" event={"ID":"ce714838-8311-4acb-8929-bc569891295a","Type":"ContainerStarted","Data":"d49dd9a14855d4a026010cafb402e9462b60af31fd1ad555dc757a92ba1e08a8"}
Sep 08 00:33:37.267458 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:37.267410    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tjn4t" podStartSLOduration=2.44082325 podStartE2EDuration="5.267397609s" totalImagesPullingTime="2.826574359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:33:37.266639029 +0000 UTC m=+39.645012461" watchObservedRunningTime="2026-09-08 00:33:37.267397609 +0000 UTC m=+39.645771041"
Sep 08 00:33:37.504134 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:37.504057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:37.601459 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:37.601416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:37.674369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:37.674341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:40.394562 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:40.394533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:40.394956 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:40.394678    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:33:40.394956 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:40.394758    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:33:48.394742448 +0000 UTC m=+50.773115894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:33:41.203328 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:41.203291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:46.271696 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:46.271662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:46.361387 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:46.361361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:47.093923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:47.093878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:47.174277 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:47.174237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:48.446772 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:48.446737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:33:48.447155 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:48.446898    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:33:48.447155 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:48.446961    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:34:04.446945752 +0000 UTC m=+66.825319163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:33:55.640188 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:55.640139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:58.218574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.218540    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tlcnm"
Sep 08 00:33:58.379413 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.379378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:58.477519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.477443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:58.959933 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.959900    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"]
Sep 08 00:33:58.962495 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.962476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:58.965223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.965199    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 00:33:58.966167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.966142    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 00:33:58.966300 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.966163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6qnw4\""
Sep 08 00:33:58.966300 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.966163    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:33:58.972667 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:58.972643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"]
Sep 08 00:33:59.020575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.020550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmh4x\" (UniqueName: \"kubernetes.io/projected/e071229a-ff6b-4f67-a722-e7aa33070c0d-kube-api-access-qmh4x\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:59.020698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.020611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:59.069665 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.069630    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-gsj8b"]
Sep 08 00:33:59.071516 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.071501    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c9cc55c7b-ftdm6"]
Sep 08 00:33:59.071636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.071621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.073493 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.073475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.074364 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.074345    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 00:33:59.074462 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.074410    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 00:33:59.074462 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.074431    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 00:33:59.074648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.074626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gjhzz\""
Sep 08 00:33:59.074721 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.074670    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 00:33:59.076224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.076206    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-465vj\""
Sep 08 00:33:59.077359 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.077340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 00:33:59.077462 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.077421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 00:33:59.077462 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.077349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 00:33:59.077709 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.077676    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 00:33:59.077805 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.077788    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 00:33:59.078033 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.078015    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 00:33:59.080186 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.080165    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 00:33:59.086342 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.086322    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-gsj8b"]
Sep 08 00:33:59.087396 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.087377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c9cc55c7b-ftdm6"]
Sep 08 00:33:59.120885 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.120857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1c2bd-2476-4475-8c88-62e9c5249322-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.120987 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.120924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:59.120987 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.120953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-default-certificate\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.120987 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.120974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.121148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05f1c2bd-2476-4475-8c88-62e9c5249322-snapshots\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.121148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1c2bd-2476-4475-8c88-62e9c5249322-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.121148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zq4x\" (UniqueName: \"kubernetes.io/projected/05f1c2bd-2476-4475-8c88-62e9c5249322-kube-api-access-4zq4x\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.121148 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.121105    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:33:59.121329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05f1c2bd-2476-4475-8c88-62e9c5249322-tmp\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.121329 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.121169    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls podName:e071229a-ff6b-4f67-a722-e7aa33070c0d nodeName:}" failed. No retries permitted until 2026-09-08 00:33:59.621149641 +0000 UTC m=+61.999523071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twxvj" (UID: "e071229a-ff6b-4f67-a722-e7aa33070c0d") : secret "samples-operator-tls" not found
Sep 08 00:33:59.121329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05f1c2bd-2476-4475-8c88-62e9c5249322-serving-cert\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.121329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.121329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhfz2\" (UniqueName: \"kubernetes.io/projected/27a21748-8b18-4b65-be93-98f3dcb9d82e-kube-api-access-rhfz2\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.121329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmh4x\" (UniqueName: \"kubernetes.io/projected/e071229a-ff6b-4f67-a722-e7aa33070c0d-kube-api-access-qmh4x\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:59.121542 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.121334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-stats-auth\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.135350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.135327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmh4x\" (UniqueName: \"kubernetes.io/projected/e071229a-ff6b-4f67-a722-e7aa33070c0d-kube-api-access-qmh4x\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:59.221799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-stats-auth\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.221799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1c2bd-2476-4475-8c88-62e9c5249322-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-default-certificate\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05f1c2bd-2476-4475-8c88-62e9c5249322-snapshots\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1c2bd-2476-4475-8c88-62e9c5249322-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zq4x\" (UniqueName: \"kubernetes.io/projected/05f1c2bd-2476-4475-8c88-62e9c5249322-kube-api-access-4zq4x\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05f1c2bd-2476-4475-8c88-62e9c5249322-tmp\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.221970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05f1c2bd-2476-4475-8c88-62e9c5249322-serving-cert\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.222010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.222163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.222047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhfz2\" (UniqueName: \"kubernetes.io/projected/27a21748-8b18-4b65-be93-98f3dcb9d82e-kube-api-access-rhfz2\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.222734 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.222358    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:59.722337653 +0000 UTC m=+62.100711071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : configmap references non-existent config key: service-ca.crt
Sep 08 00:33:59.222734 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.222580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1c2bd-2476-4475-8c88-62e9c5249322-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.222734 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.222593    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:33:59.222734 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.222644    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:33:59.722629896 +0000 UTC m=+62.101003307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : secret "router-metrics-certs-default" not found
Sep 08 00:33:59.226633 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.223056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05f1c2bd-2476-4475-8c88-62e9c5249322-tmp\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.226633 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.223206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f1c2bd-2476-4475-8c88-62e9c5249322-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.226907 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.226881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05f1c2bd-2476-4475-8c88-62e9c5249322-snapshots\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.227047 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.226994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05f1c2bd-2476-4475-8c88-62e9c5249322-serving-cert\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.227494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.227477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-default-certificate\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.227556 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.227538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-stats-auth\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.236526 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.236486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:59.238998 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.238977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhfz2\" (UniqueName: \"kubernetes.io/projected/27a21748-8b18-4b65-be93-98f3dcb9d82e-kube-api-access-rhfz2\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.239853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.239832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zq4x\" (UniqueName: \"kubernetes.io/projected/05f1c2bd-2476-4475-8c88-62e9c5249322-kube-api-access-4zq4x\") pod \"insights-operator-76bcd6ccf5-gsj8b\" (UID: \"05f1c2bd-2476-4475-8c88-62e9c5249322\") " pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.260223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.260198    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"]
Sep 08 00:33:59.262529 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.262514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.264717 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.264701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 00:33:59.264952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.264936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 00:33:59.265212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.265197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:33:59.265273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.265255    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 00:33:59.265333 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.265314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-526ct\""
Sep 08 00:33:59.275196 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.275176    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"]
Sep 08 00:33:59.322407 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.322386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjkb2\" (UniqueName: \"kubernetes.io/projected/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-kube-api-access-vjkb2\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.322500 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.322488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-serving-cert\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.322545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.322505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-config\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.325364 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.325342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:33:59.382748 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.382729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b"
Sep 08 00:33:59.423595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.423568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-serving-cert\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.423735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.423607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-config\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.423735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.423651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjkb2\" (UniqueName: \"kubernetes.io/projected/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-kube-api-access-vjkb2\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.425095 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.424654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-config\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.426718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.426693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-serving-cert\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.431841 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.431819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjkb2\" (UniqueName: \"kubernetes.io/projected/889e7223-02d3-4ebf-8a49-d56c6a7c8cd8-kube-api-access-vjkb2\") pod \"service-ca-operator-859f94c4b-5vk5v\" (UID: \"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.570490 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.570462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"
Sep 08 00:33:59.625254 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.625223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:33:59.625396 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.625379    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:33:59.625452 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.625443    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls podName:e071229a-ff6b-4f67-a722-e7aa33070c0d nodeName:}" failed. No retries permitted until 2026-09-08 00:34:00.625426603 +0000 UTC m=+63.003800015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twxvj" (UID: "e071229a-ff6b-4f67-a722-e7aa33070c0d") : secret "samples-operator-tls" not found
Sep 08 00:33:59.650882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.650856    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-gsj8b"]
Sep 08 00:33:59.653599 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:59.653576    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f1c2bd_2476_4475_8c88_62e9c5249322.slice/crio-1c6cbd10c4a2d890d35b116d55a70a64e5344e0a6d07db140b45c9bc1cd6c026 WatchSource:0}: Error finding container 1c6cbd10c4a2d890d35b116d55a70a64e5344e0a6d07db140b45c9bc1cd6c026: Status 404 returned error can't find the container with id 1c6cbd10c4a2d890d35b116d55a70a64e5344e0a6d07db140b45c9bc1cd6c026
Sep 08 00:33:59.725925 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.725903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.726016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.725948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:33:59.726061 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.726044    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:33:59.726095 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.726049    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:00.726036309 +0000 UTC m=+63.104409735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : configmap references non-existent config key: service-ca.crt
Sep 08 00:33:59.726144 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:33:59.726097    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:00.726083416 +0000 UTC m=+63.104456827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : secret "router-metrics-certs-default" not found
Sep 08 00:33:59.835806 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:33:59.835745    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v"]
Sep 08 00:33:59.839448 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:33:59.839427    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889e7223_02d3_4ebf_8a49_d56c6a7c8cd8.slice/crio-9a9a8a68dc9c2c3f144311a308f043a5afd726633dc9bee02a2a96fbd1ac0443 WatchSource:0}: Error finding container 9a9a8a68dc9c2c3f144311a308f043a5afd726633dc9bee02a2a96fbd1ac0443: Status 404 returned error can't find the container with id 9a9a8a68dc9c2c3f144311a308f043a5afd726633dc9bee02a2a96fbd1ac0443
Sep 08 00:34:00.302527 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:00.302491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v" event={"ID":"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8","Type":"ContainerStarted","Data":"9a9a8a68dc9c2c3f144311a308f043a5afd726633dc9bee02a2a96fbd1ac0443"}
Sep 08 00:34:00.303915 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:00.303889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b" event={"ID":"05f1c2bd-2476-4475-8c88-62e9c5249322","Type":"ContainerStarted","Data":"1c6cbd10c4a2d890d35b116d55a70a64e5344e0a6d07db140b45c9bc1cd6c026"}
Sep 08 00:34:00.633023 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:00.632941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:34:00.633172 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:00.633123    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:34:00.633236 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:00.633200    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls podName:e071229a-ff6b-4f67-a722-e7aa33070c0d nodeName:}" failed. No retries permitted until 2026-09-08 00:34:02.633181034 +0000 UTC m=+65.011554465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twxvj" (UID: "e071229a-ff6b-4f67-a722-e7aa33070c0d") : secret "samples-operator-tls" not found
Sep 08 00:34:00.733947 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:00.733914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:00.734093 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:00.733984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:00.734139 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:00.734100    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:02.734086655 +0000 UTC m=+65.112460065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : configmap references non-existent config key: service-ca.crt
Sep 08 00:34:00.734193 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:00.734134    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:34:00.734193 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:00.734188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:02.734177201 +0000 UTC m=+65.112550654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : secret "router-metrics-certs-default" not found
Sep 08 00:34:02.311113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.311078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v" event={"ID":"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8","Type":"ContainerStarted","Data":"5bd73ea58081ee34c8bb7886b0a157a2ebc33f36d43b7c89d0e21323d69c68cb"}
Sep 08 00:34:02.312763 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.312735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b" event={"ID":"05f1c2bd-2476-4475-8c88-62e9c5249322","Type":"ContainerStarted","Data":"5f966603c6ff662015975170efe49cad55be92f488d7bb13205b3cf15e4cb5da"}
Sep 08 00:34:02.329979 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.329937    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v" podStartSLOduration=1.058109002 podStartE2EDuration="3.329922087s" totalImagesPullingTime="2.271813085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:02.32986192 +0000 UTC m=+64.708235353" watchObservedRunningTime="2026-09-08 00:34:02.329922087 +0000 UTC m=+64.708295554"
Sep 08 00:34:02.352046 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.352001    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b" podStartSLOduration=0.89641932 podStartE2EDuration="3.351983702s" totalImagesPullingTime="2.455564382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:02.350630325 +0000 UTC m=+64.729003759" watchObservedRunningTime="2026-09-08 00:34:02.351983702 +0000 UTC m=+64.730357136"
Sep 08 00:34:02.651392 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.651356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:34:02.651551 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:02.651498    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:34:02.651610 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:02.651561    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls podName:e071229a-ff6b-4f67-a722-e7aa33070c0d nodeName:}" failed. No retries permitted until 2026-09-08 00:34:06.651546576 +0000 UTC m=+69.029919987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twxvj" (UID: "e071229a-ff6b-4f67-a722-e7aa33070c0d") : secret "samples-operator-tls" not found
Sep 08 00:34:02.752244 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.752211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:02.752356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:02.752272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:02.752395 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:02.752368    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:34:02.752432 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:02.752378    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:06.752366457 +0000 UTC m=+69.130739869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : configmap references non-existent config key: service-ca.crt
Sep 08 00:34:02.752468 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:02.752443    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:06.752427434 +0000 UTC m=+69.130800853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : secret "router-metrics-certs-default" not found
Sep 08 00:34:03.367827 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.367794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:03.379702 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.379666    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lw2bk"]
Sep 08 00:34:03.381945 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.381930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.384494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.384471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xt6cx\""
Sep 08 00:34:03.384877 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.384863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 00:34:03.386287 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.386266    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 00:34:03.395651 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.395630    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lw2bk"]
Sep 08 00:34:03.453411 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.453390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:03.458276 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.458258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3fadda5-226a-4df2-91d3-3193d735007f-data-volume\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.458345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.458283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.458345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.458308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdj6\" (UniqueName: \"kubernetes.io/projected/e3fadda5-226a-4df2-91d3-3193d735007f-kube-api-access-xkdj6\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.458415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.458383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3fadda5-226a-4df2-91d3-3193d735007f-crio-socket\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.458415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.458400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3fadda5-226a-4df2-91d3-3193d735007f-crio-socket\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3fadda5-226a-4df2-91d3-3193d735007f-crio-socket\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559374 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:03.559295    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:34:03.559374 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3fadda5-226a-4df2-91d3-3193d735007f-data-volume\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559374 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:03.559342    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:04.059328863 +0000 UTC m=+66.437702274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : configmap "kube-rbac-proxy" not found
Sep 08 00:34:03.559374 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559542 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdj6\" (UniqueName: \"kubernetes.io/projected/e3fadda5-226a-4df2-91d3-3193d735007f-kube-api-access-xkdj6\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.559594 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:03.559514    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:03.559648 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:03.559596    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:04.059578828 +0000 UTC m=+66.437952247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:03.559731 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.559641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3fadda5-226a-4df2-91d3-3193d735007f-data-volume\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.576723 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.576673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdj6\" (UniqueName: \"kubernetes.io/projected/e3fadda5-226a-4df2-91d3-3193d735007f-kube-api-access-xkdj6\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:03.700730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.700632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:03.760729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.760707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:34:03.763578 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.763559    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 00:34:03.770919 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:03.770897    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 00:34:03.771007 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:03.770957    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs podName:a1563e37-c33b-4f85-af97-fcd3017cd02e nodeName:}" failed. No retries permitted until 2026-09-08 00:35:07.770939921 +0000 UTC m=+130.149313354 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs") pod "network-metrics-daemon-vmfxh" (UID: "a1563e37-c33b-4f85-af97-fcd3017cd02e") : secret "metrics-daemon-secret" not found
Sep 08 00:34:03.771750 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.771727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:03.861122 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.861098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:34:03.861203 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.861130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:34:03.864173 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.864157    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 00:34:03.864249 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.864161    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 00:34:03.873539 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.873515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcb104ac-6bd5-48fa-998a-ca4b60684918-original-pull-secret\") pod \"global-pull-secret-syncer-d6x5s\" (UID: \"bcb104ac-6bd5-48fa-998a-ca4b60684918\") " pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:34:03.873968 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.873955    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 00:34:03.883574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.883551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dcdg\" (UniqueName: \"kubernetes.io/projected/29ca20cd-6d25-41d3-9cd8-b69e60dd62db-kube-api-access-8dcdg\") pod \"network-check-target-kc5s5\" (UID: \"29ca20cd-6d25-41d3-9cd8-b69e60dd62db\") " pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:34:03.965788 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.965738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wspvj\""
Sep 08 00:34:03.972971 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:03.972948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:34:04.063243 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.063218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:04.063358 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.063286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:04.063421 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:04.063358    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:34:04.063421 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:04.063365    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:04.063513 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:04.063432    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:05.063412557 +0000 UTC m=+67.441785983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : configmap "kube-rbac-proxy" not found
Sep 08 00:34:04.063513 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:04.063472    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:05.063453004 +0000 UTC m=+67.441826440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:04.064141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.064126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6x5s"
Sep 08 00:34:04.143189 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.143162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.263618 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.263555    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kc5s5"]
Sep 08 00:34:04.267569 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:04.267536    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ca20cd_6d25_41d3_9cd8_b69e60dd62db.slice/crio-e84c791711bdcc300418044ebaa33adc9528d14d9b3fe366a1e7dff410dc1a69 WatchSource:0}: Error finding container e84c791711bdcc300418044ebaa33adc9528d14d9b3fe366a1e7dff410dc1a69: Status 404 returned error can't find the container with id e84c791711bdcc300418044ebaa33adc9528d14d9b3fe366a1e7dff410dc1a69
Sep 08 00:34:04.271824 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.271801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.318763 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.318740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kc5s5" event={"ID":"29ca20cd-6d25-41d3-9cd8-b69e60dd62db","Type":"ContainerStarted","Data":"e84c791711bdcc300418044ebaa33adc9528d14d9b3fe366a1e7dff410dc1a69"}
Sep 08 00:34:04.337378 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.337357    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d6x5s"]
Sep 08 00:34:04.340020 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:04.340000    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb104ac_6bd5_48fa_998a_ca4b60684918.slice/crio-a53558ee63d084a54608813f63f0908b0a1f0e2a986fcd5dc3b525a2f14cea83 WatchSource:0}: Error finding container a53558ee63d084a54608813f63f0908b0a1f0e2a986fcd5dc3b525a2f14cea83: Status 404 returned error can't find the container with id a53558ee63d084a54608813f63f0908b0a1f0e2a986fcd5dc3b525a2f14cea83
Sep 08 00:34:04.373003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.372980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.464616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.464592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.466640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.466621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:34:04.466791 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:04.466777    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:34:04.466859 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:04.466840    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls podName:8dd25b20-51e3-4402-a5c6-7697c70d628c nodeName:}" failed. No retries permitted until 2026-09-08 00:34:36.466819894 +0000 UTC m=+98.845193325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls") pod "dns-default-zkkwj" (UID: "8dd25b20-51e3-4402-a5c6-7697c70d628c") : secret "dns-default-metrics-tls" not found
Sep 08 00:34:04.659346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.659318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.769481 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.769450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:04.870752 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:04.870721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:05.072038 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:05.072006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:05.072200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:05.072117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:05.072200 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:05.072127    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:34:05.072200 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:05.072188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:07.072170874 +0000 UTC m=+69.450544303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : configmap "kube-rbac-proxy" not found
Sep 08 00:34:05.072357 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:05.072240    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:05.072357 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:05.072275    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:07.072264731 +0000 UTC m=+69.450638159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:05.303152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:05.303123    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lk8hz_2e336deb-8a67-4a1a-9bec-3d76fb74379f/dns-node-resolver/0.log"
Sep 08 00:34:05.322820 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:05.322758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d6x5s" event={"ID":"bcb104ac-6bd5-48fa-998a-ca4b60684918","Type":"ContainerStarted","Data":"a53558ee63d084a54608813f63f0908b0a1f0e2a986fcd5dc3b525a2f14cea83"}
Sep 08 00:34:05.999675 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:05.999637    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-fql2p"]
Sep 08 00:34:06.001942 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.001914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.004784 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.004761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 00:34:06.004784 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.004765    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 00:34:06.004964 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.004809    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wr2s5\""
Sep 08 00:34:06.005965 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.005947    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 00:34:06.006159 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.006142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 00:34:06.012528 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.012505    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-fql2p"]
Sep 08 00:34:06.040474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.040443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:06.080988 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.080963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10556e5c-700d-43ec-9308-a71fadf7fd1d-signing-cabundle\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.081091 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.081035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqjw\" (UniqueName: \"kubernetes.io/projected/10556e5c-700d-43ec-9308-a71fadf7fd1d-kube-api-access-tlqjw\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.081156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.081136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10556e5c-700d-43ec-9308-a71fadf7fd1d-signing-key\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.115799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.115762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:06.182075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.182048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10556e5c-700d-43ec-9308-a71fadf7fd1d-signing-cabundle\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.182181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.182112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqjw\" (UniqueName: \"kubernetes.io/projected/10556e5c-700d-43ec-9308-a71fadf7fd1d-kube-api-access-tlqjw\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.182248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.182202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10556e5c-700d-43ec-9308-a71fadf7fd1d-signing-key\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.182900 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.182853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10556e5c-700d-43ec-9308-a71fadf7fd1d-signing-cabundle\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.185055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.185029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10556e5c-700d-43ec-9308-a71fadf7fd1d-signing-key\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.193560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.193540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqjw\" (UniqueName: \"kubernetes.io/projected/10556e5c-700d-43ec-9308-a71fadf7fd1d-kube-api-access-tlqjw\") pod \"service-ca-75d99c484-fql2p\" (UID: \"10556e5c-700d-43ec-9308-a71fadf7fd1d\") " pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.314006 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.313977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-fql2p"
Sep 08 00:34:06.502831 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.502805    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xs92k_8f195f69-0b1a-472a-9ff6-a522a7240933/node-ca/0.log"
Sep 08 00:34:06.601440 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.601364    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-fql2p"]
Sep 08 00:34:06.603881 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:06.603854    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10556e5c_700d_43ec_9308_a71fadf7fd1d.slice/crio-08436dcb432338d7424d91e0315aa79db214db9ee47452e927ef890ef0a6b30e WatchSource:0}: Error finding container 08436dcb432338d7424d91e0315aa79db214db9ee47452e927ef890ef0a6b30e: Status 404 returned error can't find the container with id 08436dcb432338d7424d91e0315aa79db214db9ee47452e927ef890ef0a6b30e
Sep 08 00:34:06.687382 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.687300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:34:06.687505 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:06.687491    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:34:06.687590 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:06.687571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls podName:e071229a-ff6b-4f67-a722-e7aa33070c0d nodeName:}" failed. No retries permitted until 2026-09-08 00:34:14.687534734 +0000 UTC m=+77.065908169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-twxvj" (UID: "e071229a-ff6b-4f67-a722-e7aa33070c0d") : secret "samples-operator-tls" not found
Sep 08 00:34:06.692269 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.692242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:06.789052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.788618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:06.789052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.788728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:06.789052 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:06.788892    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:34:06.789052 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:06.788943    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:14.788923577 +0000 UTC m=+77.167297003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : configmap references non-existent config key: service-ca.crt
Sep 08 00:34:06.789052 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:06.788962    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs podName:27a21748-8b18-4b65-be93-98f3dcb9d82e nodeName:}" failed. No retries permitted until 2026-09-08 00:34:14.788954427 +0000 UTC m=+77.167327845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs") pod "router-default-c9cc55c7b-ftdm6" (UID: "27a21748-8b18-4b65-be93-98f3dcb9d82e") : secret "router-metrics-certs-default" not found
Sep 08 00:34:06.797149 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:06.797119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:07.065264 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.065148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:07.090850 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.090821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:07.090957 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.090867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:07.090957 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:07.090951    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:34:07.091059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:07.090966    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:07.091059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:07.091014    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:11.090996957 +0000 UTC m=+73.469370384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : configmap "kube-rbac-proxy" not found
Sep 08 00:34:07.091059 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:07.091028    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:11.091022346 +0000 UTC m=+73.469395757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:07.103340 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.103010    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tjn4t_ce714838-8311-4acb-8929-bc569891295a/serve-healthcheck-canary/0.log"
Sep 08 00:34:07.331618 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.331534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-fql2p" event={"ID":"10556e5c-700d-43ec-9308-a71fadf7fd1d","Type":"ContainerStarted","Data":"d1d16012b9c046badcad84d530bd7604659762d5c36f21f2364cb70a1dedbfa9"}
Sep 08 00:34:07.331618 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.331594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-fql2p" event={"ID":"10556e5c-700d-43ec-9308-a71fadf7fd1d","Type":"ContainerStarted","Data":"08436dcb432338d7424d91e0315aa79db214db9ee47452e927ef890ef0a6b30e"}
Sep 08 00:34:07.354779 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:07.354720    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-fql2p" podStartSLOduration=2.354698334 podStartE2EDuration="2.354698334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:07.354405189 +0000 UTC m=+69.732778623" watchObservedRunningTime="2026-09-08 00:34:07.354698334 +0000 UTC m=+69.733071764"
Sep 08 00:34:08.111700 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:08.109835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:08.329224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:08.329124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:08.556275 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:08.556240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:08.658928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:08.658893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:08.819162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:08.819033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:08.924701 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:08.924278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:09.019735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:09.019673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:09.179165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:09.179073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:09.980248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:09.980217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:10.345268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.345233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d6x5s" event={"ID":"bcb104ac-6bd5-48fa-998a-ca4b60684918","Type":"ContainerStarted","Data":"25b54370672b1582f5bcf1a56aa4170dd66d3d00bef1c0dca0f747798a77a1b8"}
Sep 08 00:34:10.346976 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.346946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kc5s5" event={"ID":"29ca20cd-6d25-41d3-9cd8-b69e60dd62db","Type":"ContainerStarted","Data":"c1e63335e5c4ed26c564d0c199db7197cc221d2f1e2d77a6a6cb345d55e02610"}
Sep 08 00:34:10.347107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.347093    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:34:10.369056 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.369008    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d6x5s" podStartSLOduration=65.600795605 podStartE2EDuration="1m11.368988883s" totalImagesPullingTime="5.768193278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:10.367872649 +0000 UTC m=+72.746246095" watchObservedRunningTime="2026-09-08 00:34:10.368988883 +0000 UTC m=+72.747362319"
Sep 08 00:34:10.387087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.387046    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kc5s5" podStartSLOduration=65.558476777 podStartE2EDuration="1m11.387032264s" totalImagesPullingTime="5.828555487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:10.386451311 +0000 UTC m=+72.764824743" watchObservedRunningTime="2026-09-08 00:34:10.387032264 +0000 UTC m=+72.765405696"
Sep 08 00:34:10.394640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.394617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:10.723894 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.723863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:10.825555 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.825530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:10.994353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:10.994290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:11.125750 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:11.125717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:11.125868 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:11.125760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:11.125868 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:11.125850    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:34:11.125868 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:11.125864    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:11.126026 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:11.125907    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:19.125892233 +0000 UTC m=+81.504265659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : configmap "kube-rbac-proxy" not found
Sep 08 00:34:11.126026 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:11.125920    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls podName:e3fadda5-226a-4df2-91d3-3193d735007f nodeName:}" failed. No retries permitted until 2026-09-08 00:34:19.125914225 +0000 UTC m=+81.504287636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lw2bk" (UID: "e3fadda5-226a-4df2-91d3-3193d735007f") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:34:11.397901 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:11.397878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:11.800439 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:11.800411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:11.880732 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:11.880698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:12.170779 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:12.170718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:12.230107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:12.230080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:12.858285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:12.858258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:12.984620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:12.984594    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:13.180848 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:13.180770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:13.381955 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:13.381914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:13.786920 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:13.786888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:14.376444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.376402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:14.481268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.481237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:14.751978 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.751911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:34:14.754229 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.754198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e071229a-ff6b-4f67-a722-e7aa33070c0d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-twxvj\" (UID: \"e071229a-ff6b-4f67-a722-e7aa33070c0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:34:14.853052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.853022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:14.853166 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.853061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:14.853728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.853707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a21748-8b18-4b65-be93-98f3dcb9d82e-service-ca-bundle\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:14.855164 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.855147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a21748-8b18-4b65-be93-98f3dcb9d82e-metrics-certs\") pod \"router-default-c9cc55c7b-ftdm6\" (UID: \"27a21748-8b18-4b65-be93-98f3dcb9d82e\") " pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:14.872111 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.872090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"
Sep 08 00:34:14.988384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.988356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:14.995458 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:14.995433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:15.150877 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.150848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj"]
Sep 08 00:34:15.196192 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.196164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:15.260414 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.260390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c9cc55c7b-ftdm6"]
Sep 08 00:34:15.263664 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:15.263632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a21748_8b18_4b65_be93_98f3dcb9d82e.slice/crio-fe40bb97d85762d26609fa577762071adaebd863113bbd04d0db0a51ff2e5096 WatchSource:0}: Error finding container fe40bb97d85762d26609fa577762071adaebd863113bbd04d0db0a51ff2e5096: Status 404 returned error can't find the container with id fe40bb97d85762d26609fa577762071adaebd863113bbd04d0db0a51ff2e5096
Sep 08 00:34:15.365304 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.365273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6" event={"ID":"27a21748-8b18-4b65-be93-98f3dcb9d82e","Type":"ContainerStarted","Data":"93dad44016e559583e93b7db16c40927fb2a979ef3b4dcfc37d96f3f4c4b8e70"}
Sep 08 00:34:15.365455 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.365331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6" event={"ID":"27a21748-8b18-4b65-be93-98f3dcb9d82e","Type":"ContainerStarted","Data":"fe40bb97d85762d26609fa577762071adaebd863113bbd04d0db0a51ff2e5096"}
Sep 08 00:34:15.366516 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.366485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj" event={"ID":"e071229a-ff6b-4f67-a722-e7aa33070c0d","Type":"ContainerStarted","Data":"71c85e25d724b07a56d29ce100fd563f7c373e46c08f9815d8b9ce8d5018290e"}
Sep 08 00:34:15.389633 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.389589    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6" podStartSLOduration=16.389575144 podStartE2EDuration="16.389575144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:15.389511098 +0000 UTC m=+77.767884536" watchObservedRunningTime="2026-09-08 00:34:15.389575144 +0000 UTC m=+77.767948605"
Sep 08 00:34:15.578524 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.578450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:15.776314 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.776283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:15.988708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.988635    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:15.990914 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:15.990893    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:16.172466 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:16.172435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:16.370080 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:16.370049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:16.371379 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:16.371360    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c9cc55c7b-ftdm6"
Sep 08 00:34:16.516509 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:16.516467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:16.769744 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:16.769663    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:17.370129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:17.370087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:17.474334 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:17.474297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:17.577205 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:17.577043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:17.672882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:17.672762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:17.971368 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:17.971341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:18.178730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.178642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:18.378029 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.377989    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj" event={"ID":"e071229a-ff6b-4f67-a722-e7aa33070c0d","Type":"ContainerStarted","Data":"d884bdf58b3ba57b1565a5a977f9371dda697c1488520f13606239c002f6c6a9"}
Sep 08 00:34:18.378184 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.378073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj" event={"ID":"e071229a-ff6b-4f67-a722-e7aa33070c0d","Type":"ContainerStarted","Data":"a15fba90f1be82e87571634021ce6e05b579a8edbbea27c10f1e229b8966b66a"}
Sep 08 00:34:18.395321 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.395277    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-twxvj" podStartSLOduration=17.723843012 podStartE2EDuration="20.395262468s" totalImagesPullingTime="2.671419456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:18.393820063 +0000 UTC m=+80.772193497" watchObservedRunningTime="2026-09-08 00:34:18.395262468 +0000 UTC m=+80.773635891"
Sep 08 00:34:18.580194 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.580165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:18.679425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.679402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:18.990794 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:18.990711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:19.181358 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.181312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:19.183212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.183192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:19.183282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.183256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:19.183780 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.183760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3fadda5-226a-4df2-91d3-3193d735007f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:19.185635 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.185615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3fadda5-226a-4df2-91d3-3193d735007f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lw2bk\" (UID: \"e3fadda5-226a-4df2-91d3-3193d735007f\") " pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:19.290920 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.290835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lw2bk"
Sep 08 00:34:19.574449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:19.574421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lw2bk"]
Sep 08 00:34:19.576871 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:19.576834    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fadda5_226a_4df2_91d3_3193d735007f.slice/crio-b12a4f40a67d7e3597322e8951b192eb7c5f43d674697167302ef0f8907df10d WatchSource:0}: Error finding container b12a4f40a67d7e3597322e8951b192eb7c5f43d674697167302ef0f8907df10d: Status 404 returned error can't find the container with id b12a4f40a67d7e3597322e8951b192eb7c5f43d674697167302ef0f8907df10d
Sep 08 00:34:20.385960 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:20.385931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lw2bk" event={"ID":"e3fadda5-226a-4df2-91d3-3193d735007f","Type":"ContainerStarted","Data":"60bb37e4c51b31e03fb14480073dffd39008e45c595f5df22df5d55c83023108"}
Sep 08 00:34:20.386233 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:20.385986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lw2bk" event={"ID":"e3fadda5-226a-4df2-91d3-3193d735007f","Type":"ContainerStarted","Data":"5f0bb94ddfb70319bf9e406017c8405aee1b5e9e0478fa2c362cb2924c7714c3"}
Sep 08 00:34:20.386233 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:20.386006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lw2bk" event={"ID":"e3fadda5-226a-4df2-91d3-3193d735007f","Type":"ContainerStarted","Data":"b12a4f40a67d7e3597322e8951b192eb7c5f43d674697167302ef0f8907df10d"}
Sep 08 00:34:22.399752 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:22.399705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lw2bk" event={"ID":"e3fadda5-226a-4df2-91d3-3193d735007f","Type":"ContainerStarted","Data":"53af7f7621f88dee621219ddc5ee2e773df0ec96440e54f026175dd5c678feae"}
Sep 08 00:34:22.421438 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:22.421385    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lw2bk" podStartSLOduration=17.259749779 podStartE2EDuration="19.421368383s" totalImagesPullingTime="2.161618604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:34:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:22.420642959 +0000 UTC m=+84.799016433" watchObservedRunningTime="2026-09-08 00:34:22.421368383 +0000 UTC m=+84.799741815"
Sep 08 00:34:23.450676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:23.450635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:23.550439 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:23.550394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:23.671805 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:23.671759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:23.959512 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:23.959470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:24.133369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:24.133341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:24.233212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:24.233122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:24.553560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:24.553530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:24.942386 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:24.942308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:24.996660 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:24.996633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:25.335520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:25.335492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:25.543902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:25.543860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:25.677388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:25.677319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:26.752038 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:26.751986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:26.812251 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:26.812228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:29.168861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.168817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:29.263824 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.263791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:29.506506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.506478    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"]
Sep 08 00:34:29.508867 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.508852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.511987 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.511963    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 00:34:29.512956 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.512935    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 00:34:29.514209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.514187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 00:34:29.514317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.514193    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 00:34:29.514317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.514295    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xs26w\""
Sep 08 00:34:29.530912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.530892    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"]
Sep 08 00:34:29.657376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.657354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11eee914-b854-497f-887f-b50c8c3927f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5df45d84-8zh47\" (UID: \"11eee914-b854-497f-887f-b50c8c3927f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.657497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.657439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zv8\" (UniqueName: \"kubernetes.io/projected/11eee914-b854-497f-887f-b50c8c3927f5-kube-api-access-74zv8\") pod \"managed-serviceaccount-addon-agent-f5df45d84-8zh47\" (UID: \"11eee914-b854-497f-887f-b50c8c3927f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.661397 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.661377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:29.706343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.706318    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-785fd6f58b-d7zx5"]
Sep 08 00:34:29.708076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.708062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.713029 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.713013    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 00:34:29.713125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.713108    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 00:34:29.713167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.713140    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksxqj\""
Sep 08 00:34:29.714897 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.714876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 00:34:29.719804 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.719787    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 00:34:29.735714 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.735658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785fd6f58b-d7zx5"]
Sep 08 00:34:29.757904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.757881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11eee914-b854-497f-887f-b50c8c3927f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5df45d84-8zh47\" (UID: \"11eee914-b854-497f-887f-b50c8c3927f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.757991 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.757930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zv8\" (UniqueName: \"kubernetes.io/projected/11eee914-b854-497f-887f-b50c8c3927f5-kube-api-access-74zv8\") pod \"managed-serviceaccount-addon-agent-f5df45d84-8zh47\" (UID: \"11eee914-b854-497f-887f-b50c8c3927f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.760215 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.760197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11eee914-b854-497f-887f-b50c8c3927f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5df45d84-8zh47\" (UID: \"11eee914-b854-497f-887f-b50c8c3927f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.798252 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.798233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zv8\" (UniqueName: \"kubernetes.io/projected/11eee914-b854-497f-887f-b50c8c3927f5-kube-api-access-74zv8\") pod \"managed-serviceaccount-addon-agent-f5df45d84-8zh47\" (UID: \"11eee914-b854-497f-887f-b50c8c3927f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.829483 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.829465    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"
Sep 08 00:34:29.837348 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.837323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:29.859249 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-bound-sa-token\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d12f530-c546-4432-9344-4fe8f842d88c-installation-pull-secrets\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859394 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr7vs\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-kube-api-access-sr7vs\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d12f530-c546-4432-9344-4fe8f842d88c-ca-trust-extracted\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859482 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d12f530-c546-4432-9344-4fe8f842d88c-image-registry-private-configuration\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859527 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-registry-tls\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859527 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d12f530-c546-4432-9344-4fe8f842d88c-registry-certificates\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.859602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.859556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d12f530-c546-4432-9344-4fe8f842d88c-trusted-ca\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.960794 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr7vs\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-kube-api-access-sr7vs\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.960929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d12f530-c546-4432-9344-4fe8f842d88c-ca-trust-extracted\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.960929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d12f530-c546-4432-9344-4fe8f842d88c-image-registry-private-configuration\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.960929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-registry-tls\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.960929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d12f530-c546-4432-9344-4fe8f842d88c-registry-certificates\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.960929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d12f530-c546-4432-9344-4fe8f842d88c-trusted-ca\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.961167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.960938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-bound-sa-token\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.961167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.961001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d12f530-c546-4432-9344-4fe8f842d88c-installation-pull-secrets\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.961264 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.961247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d12f530-c546-4432-9344-4fe8f842d88c-ca-trust-extracted\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.961881 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.961859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d12f530-c546-4432-9344-4fe8f842d88c-registry-certificates\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.962355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.962331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d12f530-c546-4432-9344-4fe8f842d88c-trusted-ca\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.963306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.963279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d12f530-c546-4432-9344-4fe8f842d88c-image-registry-private-configuration\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.963481 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.963462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d12f530-c546-4432-9344-4fe8f842d88c-installation-pull-secrets\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.963525 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.963462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-registry-tls\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.970339 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.970318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr7vs\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-kube-api-access-sr7vs\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:29.970516 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:29.970499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d12f530-c546-4432-9344-4fe8f842d88c-bound-sa-token\") pod \"image-registry-785fd6f58b-d7zx5\" (UID: \"8d12f530-c546-4432-9344-4fe8f842d88c\") " pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:30.016834 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.016786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:30.100237 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.100208    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47"]
Sep 08 00:34:30.103898 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:30.103874    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11eee914_b854_497f_887f_b50c8c3927f5.slice/crio-02883576b65b1b062ba7ab12d2958702329f039130a41669782bbbe53258f1b2 WatchSource:0}: Error finding container 02883576b65b1b062ba7ab12d2958702329f039130a41669782bbbe53258f1b2: Status 404 returned error can't find the container with id 02883576b65b1b062ba7ab12d2958702329f039130a41669782bbbe53258f1b2
Sep 08 00:34:30.290772 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.290698    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785fd6f58b-d7zx5"]
Sep 08 00:34:30.293219 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:30.293193    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d12f530_c546_4432_9344_4fe8f842d88c.slice/crio-7cb867bb97d643108e05f17e4f82ba58186710336d8fca1cc73989c05b74461d WatchSource:0}: Error finding container 7cb867bb97d643108e05f17e4f82ba58186710336d8fca1cc73989c05b74461d: Status 404 returned error can't find the container with id 7cb867bb97d643108e05f17e4f82ba58186710336d8fca1cc73989c05b74461d
Sep 08 00:34:30.431264 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.431230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5" event={"ID":"8d12f530-c546-4432-9344-4fe8f842d88c","Type":"ContainerStarted","Data":"6fe1d523b2b4e6973fbfdc559a3fc4b73bc24dedde6f9147a98522443ea0fbce"}
Sep 08 00:34:30.431399 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.431305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5" event={"ID":"8d12f530-c546-4432-9344-4fe8f842d88c","Type":"ContainerStarted","Data":"7cb867bb97d643108e05f17e4f82ba58186710336d8fca1cc73989c05b74461d"}
Sep 08 00:34:30.431399 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.431353    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:30.432458 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.432438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47" event={"ID":"11eee914-b854-497f-887f-b50c8c3927f5","Type":"ContainerStarted","Data":"02883576b65b1b062ba7ab12d2958702329f039130a41669782bbbe53258f1b2"}
Sep 08 00:34:30.451376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:30.451336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5" podStartSLOduration=1.451326109 podStartE2EDuration="1.451326109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:30.451258916 +0000 UTC m=+92.829632350" watchObservedRunningTime="2026-09-08 00:34:30.451326109 +0000 UTC m=+92.829699539"
Sep 08 00:34:32.553138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.553103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84cf998797-2f6sh"]
Sep 08 00:34:32.555476 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.555456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.560062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.559902    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 00:34:32.560062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.559963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 00:34:32.560062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.559985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9ml86\""
Sep 08 00:34:32.560491 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.560307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 00:34:32.560491 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.560349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 00:34:32.560491 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.560364    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 00:34:32.560491 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.560368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 00:34:32.560491 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.560419    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 00:34:32.571580 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.571560    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84cf998797-2f6sh"]
Sep 08 00:34:32.684324 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.684287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2fqh\" (UniqueName: \"kubernetes.io/projected/80901bee-bf6a-411f-bc21-d3dee0104727-kube-api-access-q2fqh\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.684496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.684344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-console-config\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.684496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.684435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-service-ca\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.684625 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.684497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-oauth-serving-cert\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.684625 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.684598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-serving-cert\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.684740 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.684650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-oauth-config\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.785804 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.785766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2fqh\" (UniqueName: \"kubernetes.io/projected/80901bee-bf6a-411f-bc21-d3dee0104727-kube-api-access-q2fqh\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.785962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.785824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-console-config\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.785962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.785874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-service-ca\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.785962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.785898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-oauth-serving-cert\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.785962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.785916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-serving-cert\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.785962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.785944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-oauth-config\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.786622 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.786597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-service-ca\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.786747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.786631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-console-config\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.786833 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.786751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-oauth-serving-cert\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.788875 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.788853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-oauth-config\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.789000 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.788976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-serving-cert\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.796509 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.796446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2fqh\" (UniqueName: \"kubernetes.io/projected/80901bee-bf6a-411f-bc21-d3dee0104727-kube-api-access-q2fqh\") pod \"console-84cf998797-2f6sh\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") " pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:32.867317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:32.867292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:33.134672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.134596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84cf998797-2f6sh"]
Sep 08 00:34:33.137647 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:33.137625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80901bee_bf6a_411f_bc21_d3dee0104727.slice/crio-c2a9c4305e8e0ab32d50c634288f702455b7e9ae50ee77105ee1337518afb79b WatchSource:0}: Error finding container c2a9c4305e8e0ab32d50c634288f702455b7e9ae50ee77105ee1337518afb79b: Status 404 returned error can't find the container with id c2a9c4305e8e0ab32d50c634288f702455b7e9ae50ee77105ee1337518afb79b
Sep 08 00:34:33.446151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.446073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47" event={"ID":"11eee914-b854-497f-887f-b50c8c3927f5","Type":"ContainerStarted","Data":"27ab19019f1c2523fa1bd859f26ffac38e74ed1202107101e8e9fad9640599d5"}
Sep 08 00:34:33.447426 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.447402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf998797-2f6sh" event={"ID":"80901bee-bf6a-411f-bc21-d3dee0104727","Type":"ContainerStarted","Data":"c2a9c4305e8e0ab32d50c634288f702455b7e9ae50ee77105ee1337518afb79b"}
Sep 08 00:34:33.462754 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.462708    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5df45d84-8zh47" podStartSLOduration=1.722824842 podStartE2EDuration="4.46267929s" totalImagesPullingTime="2.739854448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:33.462298475 +0000 UTC m=+95.840671910" watchObservedRunningTime="2026-09-08 00:34:33.46267929 +0000 UTC m=+95.841068190"
Sep 08 00:34:33.647187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.647141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:33.706714 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.706633    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-tplc4"]
Sep 08 00:34:33.708849 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.708833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.711952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.711932    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 00:34:33.713086 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.713064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 00:34:33.713186 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.713108    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 00:34:33.713186 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.713068    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 00:34:33.713431 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.713412    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 00:34:33.713570 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.713500    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vpn7h\""
Sep 08 00:34:33.726121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.726099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-tplc4"]
Sep 08 00:34:33.760135 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.760109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:33.792327 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.792303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.792438 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.792391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdtx\" (UniqueName: \"kubernetes.io/projected/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-kube-api-access-zrdtx\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.792504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.792442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.792504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.792474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.838623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.838579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:33.893280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.893249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdtx\" (UniqueName: \"kubernetes.io/projected/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-kube-api-access-zrdtx\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.893280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.893278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.893431 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.893296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.893431 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.893349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.894242 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.894219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.895891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.895873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.896073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.896048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:33.902148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:33.902103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdtx\" (UniqueName: \"kubernetes.io/projected/b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1-kube-api-access-zrdtx\") pod \"prometheus-operator-6f4946db56-tplc4\" (UID: \"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:34.020483 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:34.020432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4"
Sep 08 00:34:34.299101 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:34.299076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-tplc4"]
Sep 08 00:34:34.301641 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:34.301618    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0cbbd5e_69ca_4d88_ab51_ba3f76a88fb1.slice/crio-5c8ef6419e8eea8527eab78d2808272b2f61e2d26efffa2681c998977b17f85b WatchSource:0}: Error finding container 5c8ef6419e8eea8527eab78d2808272b2f61e2d26efffa2681c998977b17f85b: Status 404 returned error can't find the container with id 5c8ef6419e8eea8527eab78d2808272b2f61e2d26efffa2681c998977b17f85b
Sep 08 00:34:34.452429 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:34.452391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4" event={"ID":"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1","Type":"ContainerStarted","Data":"5c8ef6419e8eea8527eab78d2808272b2f61e2d26efffa2681c998977b17f85b"}
Sep 08 00:34:35.931532 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:35.931489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:36.040460 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.040416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:36.462840 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.462755    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4" event={"ID":"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1","Type":"ContainerStarted","Data":"eb997a604f2b6e19c0d5bbd9c3ad7de2c32763040cdc557f50dfd1cdff5d9f67"}
Sep 08 00:34:36.462840 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.462814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4" event={"ID":"b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1","Type":"ContainerStarted","Data":"8c8dddd68d14cb7baafc3921b2aa021ca81b96d5d6cc679e491ef98f60877f14"}
Sep 08 00:34:36.464301 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.464277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf998797-2f6sh" event={"ID":"80901bee-bf6a-411f-bc21-d3dee0104727","Type":"ContainerStarted","Data":"06e20273bc6e8ce9039650e277266ae3e2f96e24c85515123f337b80b8a0a5be"}
Sep 08 00:34:36.504656 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.504621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:36.511448 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.511409    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-tplc4" podStartSLOduration=1.617610287 podStartE2EDuration="3.511394394s" totalImagesPullingTime="1.893784107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:36.485851421 +0000 UTC m=+98.864224854" watchObservedRunningTime="2026-09-08 00:34:36.511394394 +0000 UTC m=+98.889767827"
Sep 08 00:34:36.511667 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.511648    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84cf998797-2f6sh" podStartSLOduration=1.451492457 podStartE2EDuration="4.511641876s" totalImagesPullingTime="3.060149419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:36.509996529 +0000 UTC m=+98.888369973" watchObservedRunningTime="2026-09-08 00:34:36.511641876 +0000 UTC m=+98.890015308"
Sep 08 00:34:36.517942 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.517912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:34:36.520446 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.520424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dd25b20-51e3-4402-a5c6-7697c70d628c-metrics-tls\") pod \"dns-default-zkkwj\" (UID: \"8dd25b20-51e3-4402-a5c6-7697c70d628c\") " pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:34:36.792866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.792843    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bs5xs\""
Sep 08 00:34:36.794059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.794028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:36.800177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.800160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:34:36.894938 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:36.894912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:37.092202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:37.092123    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkkwj"]
Sep 08 00:34:37.095837 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:37.095812    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd25b20_51e3_4402_a5c6_7697c70d628c.slice/crio-7b7ea935170120517d697bc31939db28e2bc94e982592e4688ef480985fd9c23 WatchSource:0}: Error finding container 7b7ea935170120517d697bc31939db28e2bc94e982592e4688ef480985fd9c23: Status 404 returned error can't find the container with id 7b7ea935170120517d697bc31939db28e2bc94e982592e4688ef480985fd9c23
Sep 08 00:34:37.469902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:37.469827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkkwj" event={"ID":"8dd25b20-51e3-4402-a5c6-7697c70d628c","Type":"ContainerStarted","Data":"7b7ea935170120517d697bc31939db28e2bc94e982592e4688ef480985fd9c23"}
Sep 08 00:34:37.824594 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:37.824561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.054444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.054409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.141643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.141553    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-42vgw"]
Sep 08 00:34:38.165236 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.165212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.168086 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.167837    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 00:34:38.168086 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.167867    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 00:34:38.168261 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.168203    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5q7dp\""
Sep 08 00:34:38.168598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.168425    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 00:34:38.183012 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.182906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.274603 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.274577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.330416 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-tls\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-textfile\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-sys\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wp9t\" (UniqueName: \"kubernetes.io/projected/926b6458-2e58-4f51-8bd7-5b1996da9b91-kube-api-access-2wp9t\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/926b6458-2e58-4f51-8bd7-5b1996da9b91-metrics-client-ca\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-wtmp\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-accelerators-collector-config\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.330801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.330743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-root\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.373299 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.373225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-sys\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wp9t\" (UniqueName: \"kubernetes.io/projected/926b6458-2e58-4f51-8bd7-5b1996da9b91-kube-api-access-2wp9t\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/926b6458-2e58-4f51-8bd7-5b1996da9b91-metrics-client-ca\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-wtmp\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-sys\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-accelerators-collector-config\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-root\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-tls\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.431975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-textfile\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.432292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-textfile\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.432409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.432409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-wtmp\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.433036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.432519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/926b6458-2e58-4f51-8bd7-5b1996da9b91-metrics-client-ca\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.433036 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:38.432811    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 00:34:38.433036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.432828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-accelerators-collector-config\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.433036 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:34:38.432876    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-tls podName:926b6458-2e58-4f51-8bd7-5b1996da9b91 nodeName:}" failed. No retries permitted until 2026-09-08 00:34:38.932857471 +0000 UTC m=+101.311230904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-tls") pod "node-exporter-42vgw" (UID: "926b6458-2e58-4f51-8bd7-5b1996da9b91") : secret "node-exporter-tls" not found
Sep 08 00:34:38.433036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.432920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/926b6458-2e58-4f51-8bd7-5b1996da9b91-root\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.437751 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.437726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.444496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.444470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wp9t\" (UniqueName: \"kubernetes.io/projected/926b6458-2e58-4f51-8bd7-5b1996da9b91-kube-api-access-2wp9t\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.472654 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.472615    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.571619 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.571568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.671698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.671661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.771350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.771165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.875922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.875889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:38.935963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.935931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-tls\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:38.938460 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:38.938435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/926b6458-2e58-4f51-8bd7-5b1996da9b91-node-exporter-tls\") pod \"node-exporter-42vgw\" (UID: \"926b6458-2e58-4f51-8bd7-5b1996da9b91\") " pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:39.063661 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.063533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:39.077974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.077754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-42vgw"
Sep 08 00:34:39.163391 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:39.163352    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926b6458_2e58_4f51_8bd7_5b1996da9b91.slice/crio-09cb645c0bf28edb1af6e8473c940d7d79bb890da78c57b64a5d5c375414fe33 WatchSource:0}: Error finding container 09cb645c0bf28edb1af6e8473c940d7d79bb890da78c57b64a5d5c375414fe33: Status 404 returned error can't find the container with id 09cb645c0bf28edb1af6e8473c940d7d79bb890da78c57b64a5d5c375414fe33
Sep 08 00:34:39.165586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.165561    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:34:39.173025 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.172998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:39.189735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.189709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.190818 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.190033    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:34:39.193451 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.193429    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6pxf\""
Sep 08 00:34:39.193581 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.193529    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 00:34:39.193674 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.193587    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 00:34:39.194373 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.194351    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 00:34:39.194473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.194375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 00:34:39.195141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.194721    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 00:34:39.195141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.194738    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 00:34:39.195141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.195123    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 00:34:39.195351 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.195144    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 00:34:39.195351 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.195155    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 00:34:39.291511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.291478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:39.340226 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvmb\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-kube-api-access-4fvmb\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340226 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-tls-assets\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340226 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-config-out\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-config-volume\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-web-config\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.340576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.340567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.385016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.384982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-config-volume\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-web-config\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvmb\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-kube-api-access-4fvmb\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-tls-assets\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-config-out\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.442665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.445706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.443432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.446511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.446467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.447456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.447344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.448270 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.448214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.449363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.449313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-config-volume\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.449363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.449322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-tls-assets\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.449363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.449346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.449573 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.449510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.450156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.450128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-config-out\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.450855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.450827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.450937 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.450876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.450937 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.450911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-web-config\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.455306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.455287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvmb\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-kube-api-access-4fvmb\") pod \"alertmanager-main-0\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.479090 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.479066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42vgw" event={"ID":"926b6458-2e58-4f51-8bd7-5b1996da9b91","Type":"ContainerStarted","Data":"09cb645c0bf28edb1af6e8473c940d7d79bb890da78c57b64a5d5c375414fe33"}
Sep 08 00:34:39.501833 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.501814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:34:39.796601 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:39.796578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:34:39.798764 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:39.798733    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971ff032_bb85_45f4_8143_1f47b5876562.slice/crio-de13247b2577a78be722abd4a770f1abc631e4b600f6b9e062b7d71e73015ce8 WatchSource:0}: Error finding container de13247b2577a78be722abd4a770f1abc631e4b600f6b9e062b7d71e73015ce8: Status 404 returned error can't find the container with id de13247b2577a78be722abd4a770f1abc631e4b600f6b9e062b7d71e73015ce8
Sep 08 00:34:40.484605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:40.484572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkkwj" event={"ID":"8dd25b20-51e3-4402-a5c6-7697c70d628c","Type":"ContainerStarted","Data":"067c2ef04dc1554ad6d82a5beaac66e7bb1193c41ce448ebff2442bc4ed88a20"}
Sep 08 00:34:40.485001 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:40.484627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkkwj" event={"ID":"8dd25b20-51e3-4402-a5c6-7697c70d628c","Type":"ContainerStarted","Data":"caee807519c94f4a6b1e6f1ff000244811d46669d686f92dfe7659c8d8efd3c2"}
Sep 08 00:34:40.485001 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:40.484722    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:34:40.485849 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:40.485827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"de13247b2577a78be722abd4a770f1abc631e4b600f6b9e062b7d71e73015ce8"}
Sep 08 00:34:40.508931 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:40.508892    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zkkwj" podStartSLOduration=66.093809423 podStartE2EDuration="1m8.508880836s" totalImagesPullingTime="2.415071413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:40.507436326 +0000 UTC m=+102.885809768" watchObservedRunningTime="2026-09-08 00:34:40.508880836 +0000 UTC m=+102.887254296"
Sep 08 00:34:41.088755 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.088659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:41.214799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.214768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:41.316261 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.316214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:41.352380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.352316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kc5s5"
Sep 08 00:34:41.471738 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.471713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:41.490718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.490666    2578 generic.go:356] "Generic (PLEG): container finished" podID="926b6458-2e58-4f51-8bd7-5b1996da9b91" containerID="76d48106811533e4416c586239515770ba2e0cdfc176f16a41c7bd8adda887c3" exitCode=0
Sep 08 00:34:41.491008 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:41.490758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42vgw" event={"ID":"926b6458-2e58-4f51-8bd7-5b1996da9b91","Type":"ContainerDied","Data":"76d48106811533e4416c586239515770ba2e0cdfc176f16a41c7bd8adda887c3"}
Sep 08 00:34:42.496642 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.496605    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="08898bcebe06e925bff6a05801b07f9bfdb19d4d80367e850e865802bc6e805d" exitCode=0
Sep 08 00:34:42.497224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.496718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"08898bcebe06e925bff6a05801b07f9bfdb19d4d80367e850e865802bc6e805d"}
Sep 08 00:34:42.499285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.499257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42vgw" event={"ID":"926b6458-2e58-4f51-8bd7-5b1996da9b91","Type":"ContainerStarted","Data":"528615cedde847096499e020c44154c69a52308f6cda3bbd5eb0a33084ac5e39"}
Sep 08 00:34:42.499403 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.499310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42vgw" event={"ID":"926b6458-2e58-4f51-8bd7-5b1996da9b91","Type":"ContainerStarted","Data":"ec26f5c7e2e6a2a8a1f1bf01dfc7a04dfc77ab29c2ecc01e451f58e3726be8eb"}
Sep 08 00:34:42.518759 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.518730    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-869d6bd57-sfqmz"]
Sep 08 00:34:42.521085 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.521069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.524147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.524123    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 00:34:42.524260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.524151    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 00:34:42.524260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.524161    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 00:34:42.524558 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.524534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 00:34:42.529647 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.525241    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-psn9g\""
Sep 08 00:34:42.529647 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.525263    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9qr4d79tpu6ih\""
Sep 08 00:34:42.538861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.538840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-869d6bd57-sfqmz"]
Sep 08 00:34:42.562910 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.562869    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-42vgw" podStartSLOduration=3.072818358 podStartE2EDuration="4.56285667s" totalImagesPullingTime="1.407951491s" totalInitContainerRuntime="82.086821ms" isStatefulPod=true podCreationTimestamp="2026-09-08 00:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:42.562321158 +0000 UTC m=+104.940694591" watchObservedRunningTime="2026-09-08 00:34:42.56285667 +0000 UTC m=+104.941230102"
Sep 08 00:34:42.667883 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.667864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b0f08b9-15b0-45fa-b81e-7b9e43098607-metrics-server-audit-profiles\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.668042 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.668021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b0f08b9-15b0-45fa-b81e-7b9e43098607-audit-log\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.668129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.668106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0f08b9-15b0-45fa-b81e-7b9e43098607-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.668285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.668253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vgpd\" (UniqueName: \"kubernetes.io/projected/6b0f08b9-15b0-45fa-b81e-7b9e43098607-kube-api-access-7vgpd\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.668360 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.668288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-secret-metrics-server-client-certs\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.668360 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.668316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-secret-metrics-server-tls\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.668470 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.668394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-client-ca-bundle\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769243 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b0f08b9-15b0-45fa-b81e-7b9e43098607-audit-log\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769243 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0f08b9-15b0-45fa-b81e-7b9e43098607-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vgpd\" (UniqueName: \"kubernetes.io/projected/6b0f08b9-15b0-45fa-b81e-7b9e43098607-kube-api-access-7vgpd\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-secret-metrics-server-client-certs\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-secret-metrics-server-tls\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-client-ca-bundle\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b0f08b9-15b0-45fa-b81e-7b9e43098607-metrics-server-audit-profiles\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.769577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.769544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b0f08b9-15b0-45fa-b81e-7b9e43098607-audit-log\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.770111 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.770084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0f08b9-15b0-45fa-b81e-7b9e43098607-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.770500 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.770476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b0f08b9-15b0-45fa-b81e-7b9e43098607-metrics-server-audit-profiles\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.772246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.772215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-client-ca-bundle\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.772398 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.772373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-secret-metrics-server-client-certs\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.772439 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.772378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b0f08b9-15b0-45fa-b81e-7b9e43098607-secret-metrics-server-tls\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.779511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.779489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vgpd\" (UniqueName: \"kubernetes.io/projected/6b0f08b9-15b0-45fa-b81e-7b9e43098607-kube-api-access-7vgpd\") pod \"metrics-server-869d6bd57-sfqmz\" (UID: \"6b0f08b9-15b0-45fa-b81e-7b9e43098607\") " pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.836023 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.835990    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:34:42.856360 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.856324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:42.867646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.867624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:42.867772 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.867726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:42.873882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.873860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:42.949124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:42.949072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:43.122406 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:43.122376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-869d6bd57-sfqmz"]
Sep 08 00:34:43.126276 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:34:43.126249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0f08b9_15b0_45fa_b81e_7b9e43098607.slice/crio-2ea426bc53d36e7b76479742f87c079e186f7d1d3a0aacf476a47bbe2103be2d WatchSource:0}: Error finding container 2ea426bc53d36e7b76479742f87c079e186f7d1d3a0aacf476a47bbe2103be2d: Status 404 returned error can't find the container with id 2ea426bc53d36e7b76479742f87c079e186f7d1d3a0aacf476a47bbe2103be2d
Sep 08 00:34:43.343013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:43.342986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:43.504627 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:43.504534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz" event={"ID":"6b0f08b9-15b0-45fa-b81e-7b9e43098607","Type":"ContainerStarted","Data":"2ea426bc53d36e7b76479742f87c079e186f7d1d3a0aacf476a47bbe2103be2d"}
Sep 08 00:34:43.508897 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:43.508868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:34:44.495134 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:44.495093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:44.513771 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:44.513734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"8ea8701389f8a9e7045a312187b54c15c83ec3b05c9935eb5282e6da330d149f"}
Sep 08 00:34:44.514209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:44.513829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"c00c2273ad47bc0d4fa1eae72cf751e7c0f5d01e406aaacd7c4898937f80876e"}
Sep 08 00:34:44.514209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:44.513881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"42adfa01408237872157db9bba106c68c0b657aafd1ed6cb7f7ed44dd96e010a"}
Sep 08 00:34:44.514209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:44.513923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"2a7dc54876fa8355f56a3023a985ea5134d0b2581e493b5096d90a61d14a4cf9"}
Sep 08 00:34:44.514209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:44.514004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"17693f4736f818cf8655a825c07d84f6a7780ecec85401d43ffd3b9e461ee13e"}
Sep 08 00:34:45.520799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:45.520722    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerStarted","Data":"4cc76c85a0407418ac893bd980da1d09cd5886acbf98081ce89ae191215eb141"}
Sep 08 00:34:45.522150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:45.522123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz" event={"ID":"6b0f08b9-15b0-45fa-b81e-7b9e43098607","Type":"ContainerStarted","Data":"9e0c87ca5cf65e08923257e993cda008e4f292ba384fb51c2db6682d392dea4f"}
Sep 08 00:34:45.578182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:45.578138    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.513800502 podStartE2EDuration="6.578122282s" totalImagesPullingTime="4.039932502s" totalInitContainerRuntime="24.389278ms" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:45.577648084 +0000 UTC m=+107.956021517" watchObservedRunningTime="2026-09-08 00:34:45.578122282 +0000 UTC m=+107.956495715"
Sep 08 00:34:45.646575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:45.646457    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz" podStartSLOduration=1.936592272 podStartE2EDuration="3.646437021s" totalImagesPullingTime="1.709844749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:34:45.645472263 +0000 UTC m=+108.023845695" watchObservedRunningTime="2026-09-08 00:34:45.646437021 +0000 UTC m=+108.024810451"
Sep 08 00:34:46.009520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:46.009482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:46.147329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:46.147304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:46.408209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:46.408183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:46.523814 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:46.523773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:47.433831 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:47.433796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:47.569511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:47.569487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:47.813661 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:47.813627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:48.026751 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:48.026713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:48.681644 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:48.681613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:50.494171 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:50.494130    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zkkwj"
Sep 08 00:34:51.005549 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:51.005508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:51.106934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:51.106903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:51.441832 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:51.441808    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-785fd6f58b-d7zx5"
Sep 08 00:34:51.612698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:51.612654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:51.711629 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:51.711534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:59.071344 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:59.071304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:59.171219 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:59.171182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:59.271598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:59.271569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:34:59.699167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:34:59.699122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:02.836584 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:02.836535    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:35:02.837068 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:02.836609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:35:06.119386 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.119336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:06.221263 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.221230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:06.310250 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.310214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:06.484575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.484512    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84cf998797-2f6sh"]
Sep 08 00:35:06.619230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.619196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:06.738735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.738638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:06.814227 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:06.814196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:07.854739 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:07.854696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:35:07.857153 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:07.857126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1563e37-c33b-4f85-af97-fcd3017cd02e-metrics-certs\") pod \"network-metrics-daemon-vmfxh\" (UID: \"a1563e37-c33b-4f85-af97-fcd3017cd02e\") " pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:35:07.972890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:07.972864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5xvx4\""
Sep 08 00:35:07.980107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:07.980090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmfxh"
Sep 08 00:35:08.263839 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:08.263783    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vmfxh"]
Sep 08 00:35:08.266489 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:35:08.266462    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1563e37_c33b_4f85_af97_fcd3017cd02e.slice/crio-db9ef677f08b910377f49c738857b47173e944a2058f8f1c3d9db80154faa2f7 WatchSource:0}: Error finding container db9ef677f08b910377f49c738857b47173e944a2058f8f1c3d9db80154faa2f7: Status 404 returned error can't find the container with id db9ef677f08b910377f49c738857b47173e944a2058f8f1c3d9db80154faa2f7
Sep 08 00:35:08.608755 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:08.608719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vmfxh" event={"ID":"a1563e37-c33b-4f85-af97-fcd3017cd02e","Type":"ContainerStarted","Data":"db9ef677f08b910377f49c738857b47173e944a2058f8f1c3d9db80154faa2f7"}
Sep 08 00:35:09.613708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:09.613636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vmfxh" event={"ID":"a1563e37-c33b-4f85-af97-fcd3017cd02e","Type":"ContainerStarted","Data":"a89f2fb3510766660e7f88143ce158e45a25a8c02c94bed414c5038343db9cc8"}
Sep 08 00:35:09.614057 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:09.613711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vmfxh" event={"ID":"a1563e37-c33b-4f85-af97-fcd3017cd02e","Type":"ContainerStarted","Data":"9e75429da0bcb2918bb65cb749f0f691f44a880d86582709ae374f74d367b66c"}
Sep 08 00:35:09.635900 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:09.635860    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vmfxh" podStartSLOduration=129.595712662 podStartE2EDuration="2m10.635845848s" totalImagesPullingTime="1.040133186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:35:09.635042884 +0000 UTC m=+132.013416318" watchObservedRunningTime="2026-09-08 00:35:09.635845848 +0000 UTC m=+132.014219281"
Sep 08 00:35:09.770138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:09.770108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:09.904163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:09.904112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:14.171899 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:14.171864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:14.263508 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:14.263477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:18.586368 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:18.586311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:18.657289 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:18.657249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:18.657651 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:18.657623    2578 generic.go:356] "Generic (PLEG): container finished" podID="889e7223-02d3-4ebf-8a49-d56c6a7c8cd8" containerID="5bd73ea58081ee34c8bb7886b0a157a2ebc33f36d43b7c89d0e21323d69c68cb" exitCode=0
Sep 08 00:35:18.657748 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:18.657719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v" event={"ID":"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8","Type":"ContainerDied","Data":"5bd73ea58081ee34c8bb7886b0a157a2ebc33f36d43b7c89d0e21323d69c68cb"}
Sep 08 00:35:18.658095 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:18.658078    2578 scope.go:117] "RemoveContainer" containerID="5bd73ea58081ee34c8bb7886b0a157a2ebc33f36d43b7c89d0e21323d69c68cb"
Sep 08 00:35:19.662942 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:19.662907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5vk5v" event={"ID":"889e7223-02d3-4ebf-8a49-d56c6a7c8cd8","Type":"ContainerStarted","Data":"c60f9c58f92aec78ea4453ba24b0595c58e11e79663af20bd80d578d39ff28d2"}
Sep 08 00:35:22.841934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:22.841898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:35:22.846040 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:22.846009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-869d6bd57-sfqmz"
Sep 08 00:35:28.701641 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:28.701592    2578 generic.go:356] "Generic (PLEG): container finished" podID="05f1c2bd-2476-4475-8c88-62e9c5249322" containerID="5f966603c6ff662015975170efe49cad55be92f488d7bb13205b3cf15e4cb5da" exitCode=0
Sep 08 00:35:28.702097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:28.701694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b" event={"ID":"05f1c2bd-2476-4475-8c88-62e9c5249322","Type":"ContainerDied","Data":"5f966603c6ff662015975170efe49cad55be92f488d7bb13205b3cf15e4cb5da"}
Sep 08 00:35:28.702097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:28.702034    2578 scope.go:117] "RemoveContainer" containerID="5f966603c6ff662015975170efe49cad55be92f488d7bb13205b3cf15e4cb5da"
Sep 08 00:35:29.707393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:29.707358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-gsj8b" event={"ID":"05f1c2bd-2476-4475-8c88-62e9c5249322","Type":"ContainerStarted","Data":"c797af50f5015954b43633d1fec53e3160074e741266dc1fea0188f12bd3a979"}
Sep 08 00:35:31.507311 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.507251    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84cf998797-2f6sh" podUID="80901bee-bf6a-411f-bc21-d3dee0104727" containerName="console" containerID="cri-o://06e20273bc6e8ce9039650e277266ae3e2f96e24c85515123f337b80b8a0a5be" gracePeriod=15
Sep 08 00:35:31.716426 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.716394    2578 generic.go:356] "Generic (PLEG): container finished" podID="80901bee-bf6a-411f-bc21-d3dee0104727" containerID="06e20273bc6e8ce9039650e277266ae3e2f96e24c85515123f337b80b8a0a5be" exitCode=0
Sep 08 00:35:31.716542 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.716461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf998797-2f6sh" event={"ID":"80901bee-bf6a-411f-bc21-d3dee0104727","Type":"ContainerDied","Data":"06e20273bc6e8ce9039650e277266ae3e2f96e24c85515123f337b80b8a0a5be"}
Sep 08 00:35:31.746496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.746474    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:35:31.829105 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829084    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-console-config\") pod \"80901bee-bf6a-411f-bc21-d3dee0104727\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") "
Sep 08 00:35:31.829225 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-service-ca\") pod \"80901bee-bf6a-411f-bc21-d3dee0104727\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") "
Sep 08 00:35:31.829225 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-serving-cert\") pod \"80901bee-bf6a-411f-bc21-d3dee0104727\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") "
Sep 08 00:35:31.829225 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2fqh\" (UniqueName: \"kubernetes.io/projected/80901bee-bf6a-411f-bc21-d3dee0104727-kube-api-access-q2fqh\") pod \"80901bee-bf6a-411f-bc21-d3dee0104727\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") "
Sep 08 00:35:31.829376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-oauth-serving-cert\") pod \"80901bee-bf6a-411f-bc21-d3dee0104727\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") "
Sep 08 00:35:31.829376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-oauth-config\") pod \"80901bee-bf6a-411f-bc21-d3dee0104727\" (UID: \"80901bee-bf6a-411f-bc21-d3dee0104727\") "
Sep 08 00:35:31.829611 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829579    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-console-config" (OuterVolumeSpecName: "console-config") pod "80901bee-bf6a-411f-bc21-d3dee0104727" (UID: "80901bee-bf6a-411f-bc21-d3dee0104727"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:35:31.829611 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-service-ca" (OuterVolumeSpecName: "service-ca") pod "80901bee-bf6a-411f-bc21-d3dee0104727" (UID: "80901bee-bf6a-411f-bc21-d3dee0104727"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:35:31.829794 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.829667    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80901bee-bf6a-411f-bc21-d3dee0104727" (UID: "80901bee-bf6a-411f-bc21-d3dee0104727"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:35:31.831470 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.831443    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80901bee-bf6a-411f-bc21-d3dee0104727" (UID: "80901bee-bf6a-411f-bc21-d3dee0104727"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:35:31.831535 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.831462    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80901bee-bf6a-411f-bc21-d3dee0104727" (UID: "80901bee-bf6a-411f-bc21-d3dee0104727"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:35:31.831571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.831557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80901bee-bf6a-411f-bc21-d3dee0104727-kube-api-access-q2fqh" (OuterVolumeSpecName: "kube-api-access-q2fqh") pod "80901bee-bf6a-411f-bc21-d3dee0104727" (UID: "80901bee-bf6a-411f-bc21-d3dee0104727"). InnerVolumeSpecName "kube-api-access-q2fqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:35:31.929768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.929745    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2fqh\" (UniqueName: \"kubernetes.io/projected/80901bee-bf6a-411f-bc21-d3dee0104727-kube-api-access-q2fqh\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:35:31.929768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.929765    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-oauth-serving-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:35:31.929896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.929774    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-oauth-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:35:31.929896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.929783    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-console-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:35:31.929896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.929791    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80901bee-bf6a-411f-bc21-d3dee0104727-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:35:31.929896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:31.929798    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80901bee-bf6a-411f-bc21-d3dee0104727-console-serving-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:35:32.721917 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:32.721879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf998797-2f6sh" event={"ID":"80901bee-bf6a-411f-bc21-d3dee0104727","Type":"ContainerDied","Data":"c2a9c4305e8e0ab32d50c634288f702455b7e9ae50ee77105ee1337518afb79b"}
Sep 08 00:35:32.721917 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:32.721899    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf998797-2f6sh"
Sep 08 00:35:32.722433 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:32.721947    2578 scope.go:117] "RemoveContainer" containerID="06e20273bc6e8ce9039650e277266ae3e2f96e24c85515123f337b80b8a0a5be"
Sep 08 00:35:32.747635 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:32.747607    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84cf998797-2f6sh"]
Sep 08 00:35:32.760100 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:32.760070    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84cf998797-2f6sh"]
Sep 08 00:35:34.057009 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:34.056967    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80901bee-bf6a-411f-bc21-d3dee0104727" path="/var/lib/kubelet/pods/80901bee-bf6a-411f-bc21-d3dee0104727/volumes"
Sep 08 00:35:54.249700 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:54.249579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:54.306604 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:54.306571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:35:58.545876 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.545839    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:35:58.546282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.546110    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="alertmanager" containerID="cri-o://17693f4736f818cf8655a825c07d84f6a7780ecec85401d43ffd3b9e461ee13e" gracePeriod=120
Sep 08 00:35:58.546282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.546145    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy" containerID="cri-o://c00c2273ad47bc0d4fa1eae72cf751e7c0f5d01e406aaacd7c4898937f80876e" gracePeriod=120
Sep 08 00:35:58.546282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.546173    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="config-reloader" containerID="cri-o://2a7dc54876fa8355f56a3023a985ea5134d0b2581e493b5096d90a61d14a4cf9" gracePeriod=120
Sep 08 00:35:58.546282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.546193    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="prom-label-proxy" containerID="cri-o://4cc76c85a0407418ac893bd980da1d09cd5886acbf98081ce89ae191215eb141" gracePeriod=120
Sep 08 00:35:58.546282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.546204    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-metric" containerID="cri-o://8ea8701389f8a9e7045a312187b54c15c83ec3b05c9935eb5282e6da330d149f" gracePeriod=120
Sep 08 00:35:58.546282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.546160    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-web" containerID="cri-o://42adfa01408237872157db9bba106c68c0b657aafd1ed6cb7f7ed44dd96e010a" gracePeriod=120
Sep 08 00:35:58.835087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835024    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="4cc76c85a0407418ac893bd980da1d09cd5886acbf98081ce89ae191215eb141" exitCode=0
Sep 08 00:35:58.835087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835051    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="c00c2273ad47bc0d4fa1eae72cf751e7c0f5d01e406aaacd7c4898937f80876e" exitCode=0
Sep 08 00:35:58.835087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835064    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="2a7dc54876fa8355f56a3023a985ea5134d0b2581e493b5096d90a61d14a4cf9" exitCode=0
Sep 08 00:35:58.835087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835073    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="17693f4736f818cf8655a825c07d84f6a7780ecec85401d43ffd3b9e461ee13e" exitCode=0
Sep 08 00:35:58.835273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"4cc76c85a0407418ac893bd980da1d09cd5886acbf98081ce89ae191215eb141"}
Sep 08 00:35:58.835273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"c00c2273ad47bc0d4fa1eae72cf751e7c0f5d01e406aaacd7c4898937f80876e"}
Sep 08 00:35:58.835273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"2a7dc54876fa8355f56a3023a985ea5134d0b2581e493b5096d90a61d14a4cf9"}
Sep 08 00:35:58.835273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:58.835218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"17693f4736f818cf8655a825c07d84f6a7780ecec85401d43ffd3b9e461ee13e"}
Sep 08 00:35:59.844043 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:59.844015    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="8ea8701389f8a9e7045a312187b54c15c83ec3b05c9935eb5282e6da330d149f" exitCode=0
Sep 08 00:35:59.844372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:59.844049    2578 generic.go:356] "Generic (PLEG): container finished" podID="971ff032-bb85-45f4-8143-1f47b5876562" containerID="42adfa01408237872157db9bba106c68c0b657aafd1ed6cb7f7ed44dd96e010a" exitCode=0
Sep 08 00:35:59.844372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:59.844096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"8ea8701389f8a9e7045a312187b54c15c83ec3b05c9935eb5282e6da330d149f"}
Sep 08 00:35:59.844372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:35:59.844189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"42adfa01408237872157db9bba106c68c0b657aafd1ed6cb7f7ed44dd96e010a"}
Sep 08 00:36:00.290079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.290048    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:00.291345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291326    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-694799c854-6g8n2"]
Sep 08 00:36:00.291579 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291565    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-metric"
Sep 08 00:36:00.291613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291581    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-metric"
Sep 08 00:36:00.291613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291590    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-web"
Sep 08 00:36:00.291613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291597    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-web"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291605    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="prom-label-proxy"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291695    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="prom-label-proxy"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291709    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="init-config-reloader"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291715    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="init-config-reloader"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291724    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="config-reloader"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291729    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="config-reloader"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291738    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80901bee-bf6a-411f-bc21-d3dee0104727" containerName="console"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291743    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80901bee-bf6a-411f-bc21-d3dee0104727" containerName="console"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291748    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291753    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291766    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="alertmanager"
Sep 08 00:36:00.291786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291774    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="alertmanager"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291828    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-web"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291838    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="prom-label-proxy"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291845    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80901bee-bf6a-411f-bc21-d3dee0104727" containerName="console"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291850    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="config-reloader"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291856    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291861    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="kube-rbac-proxy-metric"
Sep 08 00:36:00.292302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.291867    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="971ff032-bb85-45f4-8143-1f47b5876562" containerName="alertmanager"
Sep 08 00:36:00.294421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.294404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.296826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.296807    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 00:36:00.296934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.296894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9ml86\""
Sep 08 00:36:00.297003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.296945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 00:36:00.297128 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.297112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 00:36:00.297287 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.297270    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 00:36:00.297440 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.297427    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 00:36:00.297511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.297498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 00:36:00.297906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.297888    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 00:36:00.302872 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.302855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 00:36:00.306218 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.306194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694799c854-6g8n2"]
Sep 08 00:36:00.345085 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.345058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:00.403030 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.402999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:00.441052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.440997    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-main-tls\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-tls-assets\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-trusted-ca-bundle\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441143    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-config-volume\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441174    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-metrics-client-ca\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441203    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-cluster-tls-config\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-config-out\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-web\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441345    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-web-config\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441385    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fvmb\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-kube-api-access-4fvmb\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441410    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-main-db\") pod \"971ff032-bb85-45f4-8143-1f47b5876562\" (UID: \"971ff032-bb85-45f4-8143-1f47b5876562\") "
Sep 08 00:36:00.441616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-serving-cert\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.441616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-oauth-config\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.441616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441568    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:36:00.441891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-oauth-serving-cert\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.441891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7psrf\" (UniqueName: \"kubernetes.io/projected/8f19d1a7-5a76-4391-bc50-9be290e96ace-kube-api-access-7psrf\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.441891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-trusted-ca-bundle\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.441891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-service-ca\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.441891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:36:00.441891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.441871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-config\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.442202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.442030    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.442202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.442053    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971ff032-bb85-45f4-8143-1f47b5876562-metrics-client-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.442712 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.442668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:36:00.444076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.444174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444085    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.444174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-config-volume" (OuterVolumeSpecName: "config-volume") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.444174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.444449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:36:00.444737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.444906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.444884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-config-out" (OuterVolumeSpecName: "config-out") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:36:00.445121 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.445090    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-kube-api-access-4fvmb" (OuterVolumeSpecName: "kube-api-access-4fvmb") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "kube-api-access-4fvmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:36:00.449637 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.449601    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.455563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.455540    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-web-config" (OuterVolumeSpecName: "web-config") pod "971ff032-bb85-45f4-8143-1f47b5876562" (UID: "971ff032-bb85-45f4-8143-1f47b5876562"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:36:00.542520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7psrf\" (UniqueName: \"kubernetes.io/projected/8f19d1a7-5a76-4391-bc50-9be290e96ace-kube-api-access-7psrf\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542607 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-trusted-ca-bundle\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542607 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-service-ca\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542607 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-config\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542755 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-serving-cert\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542755 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-oauth-config\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542755 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-oauth-serving-cert\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542771    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-web-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542789    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fvmb\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-kube-api-access-4fvmb\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542803    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-alertmanager-main-db\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542818    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-main-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542832    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971ff032-bb85-45f4-8143-1f47b5876562-tls-assets\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542847    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542861    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542874    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-cluster-tls-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542886    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971ff032-bb85-45f4-8143-1f47b5876562-config-out\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.542896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542899    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.543369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.542913    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971ff032-bb85-45f4-8143-1f47b5876562-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:36:00.543369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.543200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-service-ca\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.543472 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.543410    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-trusted-ca-bundle\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.543531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.543501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-oauth-serving-cert\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.543649 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.543627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-config\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.544676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.544656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-serving-cert\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.544905 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.544885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-oauth-config\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.550820 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.550799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7psrf\" (UniqueName: \"kubernetes.io/projected/8f19d1a7-5a76-4391-bc50-9be290e96ace-kube-api-access-7psrf\") pod \"console-694799c854-6g8n2\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") " pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.603303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.603281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:00.852365 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.852329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"971ff032-bb85-45f4-8143-1f47b5876562","Type":"ContainerDied","Data":"de13247b2577a78be722abd4a770f1abc631e4b600f6b9e062b7d71e73015ce8"}
Sep 08 00:36:00.852749 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.852393    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:00.852749 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.852407    2578 scope.go:117] "RemoveContainer" containerID="4cc76c85a0407418ac893bd980da1d09cd5886acbf98081ce89ae191215eb141"
Sep 08 00:36:00.861030 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.860996    2578 scope.go:117] "RemoveContainer" containerID="8ea8701389f8a9e7045a312187b54c15c83ec3b05c9935eb5282e6da330d149f"
Sep 08 00:36:00.868246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.868230    2578 scope.go:117] "RemoveContainer" containerID="c00c2273ad47bc0d4fa1eae72cf751e7c0f5d01e406aaacd7c4898937f80876e"
Sep 08 00:36:00.874952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.874935    2578 scope.go:117] "RemoveContainer" containerID="42adfa01408237872157db9bba106c68c0b657aafd1ed6cb7f7ed44dd96e010a"
Sep 08 00:36:00.880439 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.880417    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:36:00.882323 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.882303    2578 scope.go:117] "RemoveContainer" containerID="2a7dc54876fa8355f56a3023a985ea5134d0b2581e493b5096d90a61d14a4cf9"
Sep 08 00:36:00.882980 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.882960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694799c854-6g8n2"]
Sep 08 00:36:00.885930 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:36:00.885911    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f19d1a7_5a76_4391_bc50_9be290e96ace.slice/crio-9ff5dbc2461dd814ee849d610ea9a62ccfc554b132155396a80ffcb170080e32 WatchSource:0}: Error finding container 9ff5dbc2461dd814ee849d610ea9a62ccfc554b132155396a80ffcb170080e32: Status 404 returned error can't find the container with id 9ff5dbc2461dd814ee849d610ea9a62ccfc554b132155396a80ffcb170080e32
Sep 08 00:36:00.891463 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.891445    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:36:00.894270 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.894249    2578 scope.go:117] "RemoveContainer" containerID="17693f4736f818cf8655a825c07d84f6a7780ecec85401d43ffd3b9e461ee13e"
Sep 08 00:36:00.901297 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.901280    2578 scope.go:117] "RemoveContainer" containerID="08898bcebe06e925bff6a05801b07f9bfdb19d4d80367e850e865802bc6e805d"
Sep 08 00:36:00.912417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.912398    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:36:00.917326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.917309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:00.920066 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920021    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 00:36:00.920066 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 00:36:00.920177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920110    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 00:36:00.920297 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920273    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 00:36:00.920409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920378    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 00:36:00.920702 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 00:36:00.920789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920723    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 00:36:00.920789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920736    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 00:36:00.920896 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.920743    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6pxf\""
Sep 08 00:36:00.926497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.926480    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 00:36:00.930963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:00.930944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:36:01.046467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aef09d0-21cc-42f7-bf2b-156ad1b90629-config-out\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046609 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aef09d0-21cc-42f7-bf2b-156ad1b90629-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046609 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046609 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aef09d0-21cc-42f7-bf2b-156ad1b90629-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046609 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046609 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-config-volume\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-web-config\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aef09d0-21cc-42f7-bf2b-156ad1b90629-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm2dx\" (UniqueName: \"kubernetes.io/projected/0aef09d0-21cc-42f7-bf2b-156ad1b90629-kube-api-access-bm2dx\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.046952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.046845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0aef09d0-21cc-42f7-bf2b-156ad1b90629-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.147976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aef09d0-21cc-42f7-bf2b-156ad1b90629-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm2dx\" (UniqueName: \"kubernetes.io/projected/0aef09d0-21cc-42f7-bf2b-156ad1b90629-kube-api-access-bm2dx\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0aef09d0-21cc-42f7-bf2b-156ad1b90629-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aef09d0-21cc-42f7-bf2b-156ad1b90629-config-out\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aef09d0-21cc-42f7-bf2b-156ad1b90629-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148557 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.148746 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aef09d0-21cc-42f7-bf2b-156ad1b90629-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.149602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0aef09d0-21cc-42f7-bf2b-156ad1b90629-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.149602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.149602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.148969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-config-volume\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.149602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.149146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.149602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.149177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.149602 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.149253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-web-config\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.151571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.150121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aef09d0-21cc-42f7-bf2b-156ad1b90629-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.151571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.151099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aef09d0-21cc-42f7-bf2b-156ad1b90629-config-out\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.151571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.151476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.151785 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.151509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aef09d0-21cc-42f7-bf2b-156ad1b90629-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.152974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.152897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.156836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.153377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aef09d0-21cc-42f7-bf2b-156ad1b90629-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.156836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.153969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-config-volume\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.156836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.154640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.156836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.155490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.157280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.157256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-web-config\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.157361 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.157335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aef09d0-21cc-42f7-bf2b-156ad1b90629-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.158572 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.158551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm2dx\" (UniqueName: \"kubernetes.io/projected/0aef09d0-21cc-42f7-bf2b-156ad1b90629-kube-api-access-bm2dx\") pod \"alertmanager-main-0\" (UID: \"0aef09d0-21cc-42f7-bf2b-156ad1b90629\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.241243 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.241220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 00:36:01.526585 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.526557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 00:36:01.528988 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:36:01.528956    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aef09d0_21cc_42f7_bf2b_156ad1b90629.slice/crio-51783efd6f86f88198c8cbef8522908883f1a7fdc600f06be655957bccbb9123 WatchSource:0}: Error finding container 51783efd6f86f88198c8cbef8522908883f1a7fdc600f06be655957bccbb9123: Status 404 returned error can't find the container with id 51783efd6f86f88198c8cbef8522908883f1a7fdc600f06be655957bccbb9123
Sep 08 00:36:01.862022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.861980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694799c854-6g8n2" event={"ID":"8f19d1a7-5a76-4391-bc50-9be290e96ace","Type":"ContainerStarted","Data":"37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242"}
Sep 08 00:36:01.862436 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.862044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694799c854-6g8n2" event={"ID":"8f19d1a7-5a76-4391-bc50-9be290e96ace","Type":"ContainerStarted","Data":"9ff5dbc2461dd814ee849d610ea9a62ccfc554b132155396a80ffcb170080e32"}
Sep 08 00:36:01.863659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.863637    2578 generic.go:356] "Generic (PLEG): container finished" podID="0aef09d0-21cc-42f7-bf2b-156ad1b90629" containerID="3bfb94b4df378f7ee7fcffe0ef1a5fd7a81e97b43e0fbda30609a37bac1cde3d" exitCode=0
Sep 08 00:36:01.863767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.863676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerDied","Data":"3bfb94b4df378f7ee7fcffe0ef1a5fd7a81e97b43e0fbda30609a37bac1cde3d"}
Sep 08 00:36:01.863767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.863751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"51783efd6f86f88198c8cbef8522908883f1a7fdc600f06be655957bccbb9123"}
Sep 08 00:36:01.881560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:01.881516    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-694799c854-6g8n2" podStartSLOduration=1.8815026339999998 podStartE2EDuration="1.881502634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:36:01.880133107 +0000 UTC m=+184.258506544" watchObservedRunningTime="2026-09-08 00:36:01.881502634 +0000 UTC m=+184.259876067"
Sep 08 00:36:02.056714 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.056671    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971ff032-bb85-45f4-8143-1f47b5876562" path="/var/lib/kubelet/pods/971ff032-bb85-45f4-8143-1f47b5876562/volumes"
Sep 08 00:36:02.871877 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.871837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"21282dccac99061ddd0cefe65678c2858f4b02e84d3df6063274e718f7fb5835"}
Sep 08 00:36:02.872349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.871920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"0ab3f7cb15529544d458417bcb732e4c6ecf1fe8eb6c67ca765fb9ce78c90269"}
Sep 08 00:36:02.872349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.871964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"b019838485a80c004af6f24df2cc288b06696d479a975c7af42addb2d96add53"}
Sep 08 00:36:02.872349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.872004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"f3457b7577ba17333e35951909e626e58f1069aa18233d5167f40a586b5bcbbc"}
Sep 08 00:36:02.872349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.872055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"fbb0b272438ec1f6089dc6cc1abb239fc343a8f95a40b7b7a272b3b6ed01cf63"}
Sep 08 00:36:02.872349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.872093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0aef09d0-21cc-42f7-bf2b-156ad1b90629","Type":"ContainerStarted","Data":"1d36473d8532ff85605018e2edfcc098f8428c4fabbd9d9fe26e5a7d0414e22b"}
Sep 08 00:36:02.903051 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:02.902991    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.889485339 podStartE2EDuration="2.902968215s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.482876ms" isStatefulPod=false podCreationTimestamp="2026-09-08 00:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:36:02.901017221 +0000 UTC m=+185.279390700" watchObservedRunningTime="2026-09-08 00:36:02.902968215 +0000 UTC m=+185.281341649"
Sep 08 00:36:06.021202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:06.021159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:06.122372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:06.122335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:10.604155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:10.604103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:10.604552 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:10.604179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:10.609136 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:10.609109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:10.911347 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:10.911260    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:36:11.059097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:11.059067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:11.118127 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:11.118077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:11.180099 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:11.180005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:14.163843 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:14.163792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:14.264698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:14.264639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:29.574588 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:29.574540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:59.792341 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:59.792301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:36:59.843188 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:36:59.843157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:19.669572 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:19.669535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:19.722562 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:19.722531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:21.499221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:21.499124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:32.295569 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:32.295516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:32.407961 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:32.407924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:32.548552 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:32.548471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:32.710052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:32.710015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:33.966066 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:33.966025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:34.061790 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.061753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:34.757138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.757103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"]
Sep 08 00:37:34.760780 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.760760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:34.763365 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.763334    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 00:37:34.763365 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.763363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 00:37:34.764395 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.764375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9ctc\""
Sep 08 00:37:34.769564 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.769540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"]
Sep 08 00:37:34.901258 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.901230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:34.901363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.901283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlfl\" (UniqueName: \"kubernetes.io/projected/aa466794-bf2a-406c-a537-e62e87d0e3d2-kube-api-access-2xlfl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:34.901406 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:34.901369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.002352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.002319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.002797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.002382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlfl\" (UniqueName: \"kubernetes.io/projected/aa466794-bf2a-406c-a537-e62e87d0e3d2-kube-api-access-2xlfl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.002797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.002448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.002924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.002818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.002924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.002891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.010663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.010599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlfl\" (UniqueName: \"kubernetes.io/projected/aa466794-bf2a-406c-a537-e62e87d0e3d2-kube-api-access-2xlfl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.071241 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.071218    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:37:35.100389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.100361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:35.342221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.342198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"]
Sep 08 00:37:35.344654 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:35.344626    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa466794_bf2a_406c_a537_e62e87d0e3d2.slice/crio-68c0f90ee87c2b7f0b77ac5daed99fcc7f038d8db8b76d4c4249643f817fd900 WatchSource:0}: Error finding container 68c0f90ee87c2b7f0b77ac5daed99fcc7f038d8db8b76d4c4249643f817fd900: Status 404 returned error can't find the container with id 68c0f90ee87c2b7f0b77ac5daed99fcc7f038d8db8b76d4c4249643f817fd900
Sep 08 00:37:35.609005 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.608951    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"]
Sep 08 00:37:35.613239 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.613223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.621479 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.621447    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"]
Sep 08 00:37:35.707930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.707909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.708016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.707946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf86z\" (UniqueName: \"kubernetes.io/projected/44450c37-3b12-4cf7-a877-7293d956292b-kube-api-access-lf86z\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.708016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.707983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.809247 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.809220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.809340 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.809283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.809340 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.809319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf86z\" (UniqueName: \"kubernetes.io/projected/44450c37-3b12-4cf7-a877-7293d956292b-kube-api-access-lf86z\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.809658 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.809622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.809658 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.809636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.817870 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.817849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf86z\" (UniqueName: \"kubernetes.io/projected/44450c37-3b12-4cf7-a877-7293d956292b-kube-api-access-lf86z\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:35.922911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:35.922835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:36.197889 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.197864    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"]
Sep 08 00:37:36.200382 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:36.200345    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44450c37_3b12_4cf7_a877_7293d956292b.slice/crio-f66230021249e95cf82911078d977b06212ca708d9f8a9e0aef0d52104011298 WatchSource:0}: Error finding container f66230021249e95cf82911078d977b06212ca708d9f8a9e0aef0d52104011298: Status 404 returned error can't find the container with id f66230021249e95cf82911078d977b06212ca708d9f8a9e0aef0d52104011298
Sep 08 00:37:36.239645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.239612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn" event={"ID":"aa466794-bf2a-406c-a537-e62e87d0e3d2","Type":"ContainerStarted","Data":"68c0f90ee87c2b7f0b77ac5daed99fcc7f038d8db8b76d4c4249643f817fd900"}
Sep 08 00:37:36.240974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.240947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs" event={"ID":"44450c37-3b12-4cf7-a877-7293d956292b","Type":"ContainerStarted","Data":"f66230021249e95cf82911078d977b06212ca708d9f8a9e0aef0d52104011298"}
Sep 08 00:37:36.442011 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.441973    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"]
Sep 08 00:37:36.446875 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.446853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.454537 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.454474    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"]
Sep 08 00:37:36.615779 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.615729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbnfk\" (UniqueName: \"kubernetes.io/projected/e8279dd9-9782-4084-8049-102e9bc6f7e3-kube-api-access-cbnfk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.615935 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.615838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.615935 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.615891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.716891 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.716820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnfk\" (UniqueName: \"kubernetes.io/projected/e8279dd9-9782-4084-8049-102e9bc6f7e3-kube-api-access-cbnfk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.717028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.716894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.717028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.716944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.717376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.717353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.717450 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.717401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.726159 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.726115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnfk\" (UniqueName: \"kubernetes.io/projected/e8279dd9-9782-4084-8049-102e9bc6f7e3-kube-api-access-cbnfk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.739930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.739907    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"]
Sep 08 00:37:36.749711 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.749509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:36.751783 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.751757    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"]
Sep 08 00:37:36.759407 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.758661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:36.918911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.918879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:36.919061 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.918990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls466\" (UniqueName: \"kubernetes.io/projected/8f677951-3e08-4ddd-924a-1b6934bc1824-kube-api-access-ls466\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:36.919135 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:36.919070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.019789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.019711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.019789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.019765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.019977 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.019846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls466\" (UniqueName: \"kubernetes.io/projected/8f677951-3e08-4ddd-924a-1b6934bc1824-kube-api-access-ls466\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.020214 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.020162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.020327 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.020206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.029210 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.029164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls466\" (UniqueName: \"kubernetes.io/projected/8f677951-3e08-4ddd-924a-1b6934bc1824-kube-api-access-ls466\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.045946 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.045884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"]
Sep 08 00:37:37.048649 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:37.048625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8279dd9_9782_4084_8049_102e9bc6f7e3.slice/crio-4f7ac5db4c9f5d02d8d1ee1d24810d3e8122e0e26406334583ae0206cee0289f WatchSource:0}: Error finding container 4f7ac5db4c9f5d02d8d1ee1d24810d3e8122e0e26406334583ae0206cee0289f: Status 404 returned error can't find the container with id 4f7ac5db4c9f5d02d8d1ee1d24810d3e8122e0e26406334583ae0206cee0289f
Sep 08 00:37:37.063663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.063637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:37.247285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.247242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv" event={"ID":"e8279dd9-9782-4084-8049-102e9bc6f7e3","Type":"ContainerStarted","Data":"4f7ac5db4c9f5d02d8d1ee1d24810d3e8122e0e26406334583ae0206cee0289f"}
Sep 08 00:37:37.349319 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.349244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"]
Sep 08 00:37:37.353295 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:37.353256    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f677951_3e08_4ddd_924a_1b6934bc1824.slice/crio-da5cc3b9d6c8638ca9754fe5677007ab4288363bfd4fe22dc9a71dd122424a01 WatchSource:0}: Error finding container da5cc3b9d6c8638ca9754fe5677007ab4288363bfd4fe22dc9a71dd122424a01: Status 404 returned error can't find the container with id da5cc3b9d6c8638ca9754fe5677007ab4288363bfd4fe22dc9a71dd122424a01
Sep 08 00:37:37.880868 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.880628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:37.942416 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:37.942164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:38.256290 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.256209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn" event={"ID":"8f677951-3e08-4ddd-924a-1b6934bc1824","Type":"ContainerStarted","Data":"da5cc3b9d6c8638ca9754fe5677007ab4288363bfd4fe22dc9a71dd122424a01"}
Sep 08 00:37:38.637613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.637581    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"]
Sep 08 00:37:38.641315 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.641289    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.646825 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.646803    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 00:37:38.647078 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.647060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tdrvz\""
Sep 08 00:37:38.655083 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.655059    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"]
Sep 08 00:37:38.675035 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.674986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:38.706847 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.706822    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"]
Sep 08 00:37:38.711554 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.711534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.714382 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.714354    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-5vqw4\""
Sep 08 00:37:38.720635 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.720612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"]
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edcd4584-56dc-4162-9f47-36784db854cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzpqb\" (UniqueName: \"kubernetes.io/projected/edcd4584-56dc-4162-9f47-36784db854cc-kube-api-access-hzpqb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edcd4584-56dc-4162-9f47-36784db854cc-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.734384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.733989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edcd4584-56dc-4162-9f47-36784db854cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.740499 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.740395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:38.831659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.831602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:38.835140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835287 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwv2\" (UniqueName: \"kubernetes.io/projected/f8a8673a-3424-45c3-98d1-323473d7a065-kube-api-access-cjwv2\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.835287 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8a8673a-3424-45c3-98d1-323473d7a065-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.835417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8a8673a-3424-45c3-98d1-323473d7a065-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.835417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8a8673a-3424-45c3-98d1-323473d7a065-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.835417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edcd4584-56dc-4162-9f47-36784db854cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzpqb\" (UniqueName: \"kubernetes.io/projected/edcd4584-56dc-4162-9f47-36784db854cc-kube-api-access-hzpqb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edcd4584-56dc-4162-9f47-36784db854cc-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.835672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.836143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.836143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edcd4584-56dc-4162-9f47-36784db854cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.836143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.836143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.835827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.836143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.836115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.836525 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.836501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edcd4584-56dc-4162-9f47-36784db854cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.836852 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.836808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.837061 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.837035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.839194 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.839170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edcd4584-56dc-4162-9f47-36784db854cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.841164 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.841140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edcd4584-56dc-4162-9f47-36784db854cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.845073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.845021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edcd4584-56dc-4162-9f47-36784db854cc-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.845626 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.845597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzpqb\" (UniqueName: \"kubernetes.io/projected/edcd4584-56dc-4162-9f47-36784db854cc-kube-api-access-hzpqb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rwdt9\" (UID: \"edcd4584-56dc-4162-9f47-36784db854cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:38.936435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.936435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwv2\" (UniqueName: \"kubernetes.io/projected/f8a8673a-3424-45c3-98d1-323473d7a065-kube-api-access-cjwv2\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.936435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8a8673a-3424-45c3-98d1-323473d7a065-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.936435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8a8673a-3424-45c3-98d1-323473d7a065-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.936751 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8a8673a-3424-45c3-98d1-323473d7a065-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.936944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8a8673a-3424-45c3-98d1-323473d7a065-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.937639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.938158 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.937702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.941286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.941244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8a8673a-3424-45c3-98d1-323473d7a065-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.942207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.942184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8a8673a-3424-45c3-98d1-323473d7a065-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.947003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.946660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8a8673a-3424-45c3-98d1-323473d7a065-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.947003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.946962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwv2\" (UniqueName: \"kubernetes.io/projected/f8a8673a-3424-45c3-98d1-323473d7a065-kube-api-access-cjwv2\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2\" (UID: \"f8a8673a-3424-45c3-98d1-323473d7a065\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:38.964074 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:38.963846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:39.029482 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:39.029201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:39.267127 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:39.267049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"]
Sep 08 00:37:39.275405 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:39.275373    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedcd4584_56dc_4162_9f47_36784db854cc.slice/crio-042b6fb2dcfb326373b8c43b1613815518a97db208b42cd01d0084d712ac7162 WatchSource:0}: Error finding container 042b6fb2dcfb326373b8c43b1613815518a97db208b42cd01d0084d712ac7162: Status 404 returned error can't find the container with id 042b6fb2dcfb326373b8c43b1613815518a97db208b42cd01d0084d712ac7162
Sep 08 00:37:39.346090 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:39.345835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"]
Sep 08 00:37:39.350094 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:39.350065    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a8673a_3424_45c3_98d1_323473d7a065.slice/crio-30db9cc868a977346fffe8fd58771baedefb5493661ccdf3c7c6eecedc55c647 WatchSource:0}: Error finding container 30db9cc868a977346fffe8fd58771baedefb5493661ccdf3c7c6eecedc55c647: Status 404 returned error can't find the container with id 30db9cc868a977346fffe8fd58771baedefb5493661ccdf3c7c6eecedc55c647
Sep 08 00:37:40.273185 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:40.273110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" event={"ID":"edcd4584-56dc-4162-9f47-36784db854cc","Type":"ContainerStarted","Data":"042b6fb2dcfb326373b8c43b1613815518a97db208b42cd01d0084d712ac7162"}
Sep 08 00:37:40.274806 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:40.274742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2" event={"ID":"f8a8673a-3424-45c3-98d1-323473d7a065","Type":"ContainerStarted","Data":"30db9cc868a977346fffe8fd58771baedefb5493661ccdf3c7c6eecedc55c647"}
Sep 08 00:37:41.745336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:41.745274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:43.295538 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.295502    2578 generic.go:356] "Generic (PLEG): container finished" podID="44450c37-3b12-4cf7-a877-7293d956292b" containerID="47c3a70c023abb264f961c64985d691c45f94d5bf9338a8293193f462bfc8a86" exitCode=0
Sep 08 00:37:43.295970 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.295594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs" event={"ID":"44450c37-3b12-4cf7-a877-7293d956292b","Type":"ContainerDied","Data":"47c3a70c023abb264f961c64985d691c45f94d5bf9338a8293193f462bfc8a86"}
Sep 08 00:37:43.297508 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.297483    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerID="574e43112f0d402e56d462760975ba40d96687e7f7a21c38be91f0a821f3f6ba" exitCode=0
Sep 08 00:37:43.297648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.297558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv" event={"ID":"e8279dd9-9782-4084-8049-102e9bc6f7e3","Type":"ContainerDied","Data":"574e43112f0d402e56d462760975ba40d96687e7f7a21c38be91f0a821f3f6ba"}
Sep 08 00:37:43.300201 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.300069    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerID="9d5eaf3edede5f033775279755c65cc3a0b5b31098da5420b70001e996852466" exitCode=0
Sep 08 00:37:43.301113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.300618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn" event={"ID":"aa466794-bf2a-406c-a537-e62e87d0e3d2","Type":"ContainerDied","Data":"9d5eaf3edede5f033775279755c65cc3a0b5b31098da5420b70001e996852466"}
Sep 08 00:37:43.303271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.303211    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerID="7988f5beabcdc4ec31790cf28e7b471eacd2a630ec6f21cb2787cc2c76243adf" exitCode=0
Sep 08 00:37:43.303271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:43.303243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn" event={"ID":"8f677951-3e08-4ddd-924a-1b6934bc1824","Type":"ContainerDied","Data":"7988f5beabcdc4ec31790cf28e7b471eacd2a630ec6f21cb2787cc2c76243adf"}
Sep 08 00:37:44.749140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:44.749096    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:37:44.749487 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:44.749183    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:37:44.749487 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:44.749214    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:37:44.755407 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:44.755381    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:37:44.755470 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:44.755438    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:37:44.755508 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:44.755475    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:37:45.313266 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.313234    2578 generic.go:356] "Generic (PLEG): container finished" podID="44450c37-3b12-4cf7-a877-7293d956292b" containerID="1a1b62f81b7026aa692b7abe3df31d741d6876c3f86e5acef2eb34f0ee65295e" exitCode=0
Sep 08 00:37:45.313383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.313313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs" event={"ID":"44450c37-3b12-4cf7-a877-7293d956292b","Type":"ContainerDied","Data":"1a1b62f81b7026aa692b7abe3df31d741d6876c3f86e5acef2eb34f0ee65295e"}
Sep 08 00:37:45.315342 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.315315    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerID="192d9d6c56887c09b26a2f9e5f32b32bb52895f2080a00978164fdff2f12e550" exitCode=0
Sep 08 00:37:45.315434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.315348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv" event={"ID":"e8279dd9-9782-4084-8049-102e9bc6f7e3","Type":"ContainerDied","Data":"192d9d6c56887c09b26a2f9e5f32b32bb52895f2080a00978164fdff2f12e550"}
Sep 08 00:37:45.317282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.317240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" event={"ID":"edcd4584-56dc-4162-9f47-36784db854cc","Type":"ContainerStarted","Data":"a15689c7050aab59b20c713978303ad7924c685d19a60c932b4c20ea06bc0568"}
Sep 08 00:37:45.319005 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.318984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2" event={"ID":"f8a8673a-3424-45c3-98d1-323473d7a065","Type":"ContainerStarted","Data":"678912fd4a5afc8d2da658117cc3af6093fc7a0aed722c82b185e983a2c35aec"}
Sep 08 00:37:45.321140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.321119    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerID="53097cb484dc91f9eb9155271c25c800f29419119fa708325eb880a8557f1856" exitCode=0
Sep 08 00:37:45.321219 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.321171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn" event={"ID":"8f677951-3e08-4ddd-924a-1b6934bc1824","Type":"ContainerDied","Data":"53097cb484dc91f9eb9155271c25c800f29419119fa708325eb880a8557f1856"}
Sep 08 00:37:45.348373 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.348331    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2" podStartSLOduration=1.9530447579999999 podStartE2EDuration="7.348318161s" totalImagesPullingTime="5.395273403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:37:45.346293099 +0000 UTC m=+287.724666554" watchObservedRunningTime="2026-09-08 00:37:45.348318161 +0000 UTC m=+287.726691594"
Sep 08 00:37:45.365803 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.365766    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" podStartSLOduration=1.888267176 podStartE2EDuration="7.365753183s" totalImagesPullingTime="5.477486007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:37:45.363964113 +0000 UTC m=+287.742337547" watchObservedRunningTime="2026-09-08 00:37:45.365753183 +0000 UTC m=+287.744126615"
Sep 08 00:37:45.964904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.964827    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:45.971387 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:45.971359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:46.030632 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:46.030539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:46.038102 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:46.037888    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:46.328464 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:46.328367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:46.328464 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:46.328430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:46.329546 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:46.329329    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:37:46.329677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:46.329612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2"
Sep 08 00:37:52.364492 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:52.364457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs" event={"ID":"44450c37-3b12-4cf7-a877-7293d956292b","Type":"ContainerStarted","Data":"512699cff5724cc27d6625b51c4454c4690a34a7801d33bbb65e80814d81060a"}
Sep 08 00:37:52.366594 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:52.366572    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerID="5db8cae877ef5d2feff92f23b7605de1785c1426a69ff3683838c53b30715c4b" exitCode=0
Sep 08 00:37:52.366766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:52.366650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv" event={"ID":"e8279dd9-9782-4084-8049-102e9bc6f7e3","Type":"ContainerDied","Data":"5db8cae877ef5d2feff92f23b7605de1785c1426a69ff3683838c53b30715c4b"}
Sep 08 00:37:52.373631 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:52.373596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn" event={"ID":"8f677951-3e08-4ddd-924a-1b6934bc1824","Type":"ContainerStarted","Data":"73234198d366577e8ac7479a8cf31dc1e05121d2db54308604bc2803d48db80b"}
Sep 08 00:37:53.381325 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.381287    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerID="73234198d366577e8ac7479a8cf31dc1e05121d2db54308604bc2803d48db80b" exitCode=0
Sep 08 00:37:53.381822 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.381374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn" event={"ID":"8f677951-3e08-4ddd-924a-1b6934bc1824","Type":"ContainerDied","Data":"73234198d366577e8ac7479a8cf31dc1e05121d2db54308604bc2803d48db80b"}
Sep 08 00:37:53.383818 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.383789    2578 generic.go:356] "Generic (PLEG): container finished" podID="44450c37-3b12-4cf7-a877-7293d956292b" containerID="512699cff5724cc27d6625b51c4454c4690a34a7801d33bbb65e80814d81060a" exitCode=0
Sep 08 00:37:53.384008 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.383873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs" event={"ID":"44450c37-3b12-4cf7-a877-7293d956292b","Type":"ContainerDied","Data":"512699cff5724cc27d6625b51c4454c4690a34a7801d33bbb65e80814d81060a"}
Sep 08 00:37:53.534273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.534247    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:53.537072 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.537052    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:53.568025 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.568006    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:53.576063 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.576043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls466\" (UniqueName: \"kubernetes.io/projected/8f677951-3e08-4ddd-924a-1b6934bc1824-kube-api-access-ls466\") pod \"8f677951-3e08-4ddd-924a-1b6934bc1824\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") "
Sep 08 00:37:53.576156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.576100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-bundle\") pod \"8f677951-3e08-4ddd-924a-1b6934bc1824\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") "
Sep 08 00:37:53.576156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.576128    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-util\") pod \"8f677951-3e08-4ddd-924a-1b6934bc1824\" (UID: \"8f677951-3e08-4ddd-924a-1b6934bc1824\") "
Sep 08 00:37:53.576265 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.576175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf86z\" (UniqueName: \"kubernetes.io/projected/44450c37-3b12-4cf7-a877-7293d956292b-kube-api-access-lf86z\") pod \"44450c37-3b12-4cf7-a877-7293d956292b\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") "
Sep 08 00:37:53.576265 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.576211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-util\") pod \"44450c37-3b12-4cf7-a877-7293d956292b\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") "
Sep 08 00:37:53.576265 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.576236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-bundle\") pod \"44450c37-3b12-4cf7-a877-7293d956292b\" (UID: \"44450c37-3b12-4cf7-a877-7293d956292b\") "
Sep 08 00:37:53.577244 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.577107    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-bundle" (OuterVolumeSpecName: "bundle") pod "44450c37-3b12-4cf7-a877-7293d956292b" (UID: "44450c37-3b12-4cf7-a877-7293d956292b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:53.577244 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.577141    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-bundle" (OuterVolumeSpecName: "bundle") pod "8f677951-3e08-4ddd-924a-1b6934bc1824" (UID: "8f677951-3e08-4ddd-924a-1b6934bc1824"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:53.579744 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.579658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f677951-3e08-4ddd-924a-1b6934bc1824-kube-api-access-ls466" (OuterVolumeSpecName: "kube-api-access-ls466") pod "8f677951-3e08-4ddd-924a-1b6934bc1824" (UID: "8f677951-3e08-4ddd-924a-1b6934bc1824"). InnerVolumeSpecName "kube-api-access-ls466". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:37:53.579827 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.579751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44450c37-3b12-4cf7-a877-7293d956292b-kube-api-access-lf86z" (OuterVolumeSpecName: "kube-api-access-lf86z") pod "44450c37-3b12-4cf7-a877-7293d956292b" (UID: "44450c37-3b12-4cf7-a877-7293d956292b"). InnerVolumeSpecName "kube-api-access-lf86z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:37:53.583217 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.583196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-util" (OuterVolumeSpecName: "util") pod "44450c37-3b12-4cf7-a877-7293d956292b" (UID: "44450c37-3b12-4cf7-a877-7293d956292b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:53.586151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.586109    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-util" (OuterVolumeSpecName: "util") pod "8f677951-3e08-4ddd-924a-1b6934bc1824" (UID: "8f677951-3e08-4ddd-924a-1b6934bc1824"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:53.677143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677087    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-util\") pod \"e8279dd9-9782-4084-8049-102e9bc6f7e3\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") "
Sep 08 00:37:53.677143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677131    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbnfk\" (UniqueName: \"kubernetes.io/projected/e8279dd9-9782-4084-8049-102e9bc6f7e3-kube-api-access-cbnfk\") pod \"e8279dd9-9782-4084-8049-102e9bc6f7e3\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") "
Sep 08 00:37:53.677273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-bundle\") pod \"e8279dd9-9782-4084-8049-102e9bc6f7e3\" (UID: \"e8279dd9-9782-4084-8049-102e9bc6f7e3\") "
Sep 08 00:37:53.677341 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677328    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-util\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.677393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677342    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44450c37-3b12-4cf7-a877-7293d956292b-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.677393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677351    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls466\" (UniqueName: \"kubernetes.io/projected/8f677951-3e08-4ddd-924a-1b6934bc1824-kube-api-access-ls466\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.677393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677361    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.677393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677369    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f677951-3e08-4ddd-924a-1b6934bc1824-util\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.677393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677377    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf86z\" (UniqueName: \"kubernetes.io/projected/44450c37-3b12-4cf7-a877-7293d956292b-kube-api-access-lf86z\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.677780 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.677758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-bundle" (OuterVolumeSpecName: "bundle") pod "e8279dd9-9782-4084-8049-102e9bc6f7e3" (UID: "e8279dd9-9782-4084-8049-102e9bc6f7e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:53.679240 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.679209    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8279dd9-9782-4084-8049-102e9bc6f7e3-kube-api-access-cbnfk" (OuterVolumeSpecName: "kube-api-access-cbnfk") pod "e8279dd9-9782-4084-8049-102e9bc6f7e3" (UID: "e8279dd9-9782-4084-8049-102e9bc6f7e3"). InnerVolumeSpecName "kube-api-access-cbnfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:37:53.682650 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.682626    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-util" (OuterVolumeSpecName: "util") pod "e8279dd9-9782-4084-8049-102e9bc6f7e3" (UID: "e8279dd9-9782-4084-8049-102e9bc6f7e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:53.778532 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.778507    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.778532 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.778528    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8279dd9-9782-4084-8049-102e9bc6f7e3-util\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:53.778645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:53.778538    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbnfk\" (UniqueName: \"kubernetes.io/projected/e8279dd9-9782-4084-8049-102e9bc6f7e3-kube-api-access-cbnfk\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:37:54.390560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.390484    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn"
Sep 08 00:37:54.390935 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.390483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053xsfdn" event={"ID":"8f677951-3e08-4ddd-924a-1b6934bc1824","Type":"ContainerDied","Data":"da5cc3b9d6c8638ca9754fe5677007ab4288363bfd4fe22dc9a71dd122424a01"}
Sep 08 00:37:54.390935 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.390609    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da5cc3b9d6c8638ca9754fe5677007ab4288363bfd4fe22dc9a71dd122424a01"
Sep 08 00:37:54.392748 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.392723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs" event={"ID":"44450c37-3b12-4cf7-a877-7293d956292b","Type":"ContainerDied","Data":"f66230021249e95cf82911078d977b06212ca708d9f8a9e0aef0d52104011298"}
Sep 08 00:37:54.392748 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.392734    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954ef7hgs"
Sep 08 00:37:54.392925 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.392762    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f66230021249e95cf82911078d977b06212ca708d9f8a9e0aef0d52104011298"
Sep 08 00:37:54.394895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.394874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv" event={"ID":"e8279dd9-9782-4084-8049-102e9bc6f7e3","Type":"ContainerDied","Data":"4f7ac5db4c9f5d02d8d1ee1d24810d3e8122e0e26406334583ae0206cee0289f"}
Sep 08 00:37:54.395005 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.394905    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f7ac5db4c9f5d02d8d1ee1d24810d3e8122e0e26406334583ae0206cee0289f"
Sep 08 00:37:54.395005 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:54.395002    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbljgv"
Sep 08 00:37:57.110485 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.110454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:57.200006 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.199972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:57.724806 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.724776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:57.933397 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.933351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:57.975053 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.974985    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"]
Sep 08 00:37:57.975441 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975422    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="util"
Sep 08 00:37:57.975441 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975442    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="util"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975455    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="pull"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975463    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="pull"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975477    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="util"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975484    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="util"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975502    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="pull"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975510    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="pull"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975519    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="extract"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975526    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="extract"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975538    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="util"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975546    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="util"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975557    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="extract"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975565    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="extract"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975578    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="pull"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975587    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="pull"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975599    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="extract"
Sep 08 00:37:57.975640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975606    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="extract"
Sep 08 00:37:57.976390 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975726    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8279dd9-9782-4084-8049-102e9bc6f7e3" containerName="extract"
Sep 08 00:37:57.976390 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975743    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f677951-3e08-4ddd-924a-1b6934bc1824" containerName="extract"
Sep 08 00:37:57.976390 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.975753    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="44450c37-3b12-4cf7-a877-7293d956292b" containerName="extract"
Sep 08 00:37:57.991708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:57.991674    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 00:37:58.009234 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.009212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"]
Sep 08 00:37:58.009336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.009302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.015147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.015029    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.015231    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.015309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.015427    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-4zkls\""
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.016077    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.016108    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.052947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.112116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.112174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.112192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.112262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94503909-6235-4430-a059-d6ecba6a2b22-tmp\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.112317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94503909-6235-4430-a059-d6ecba6a2b22-manifests\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.112359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddczn\" (UniqueName: \"kubernetes.io/projected/94503909-6235-4430-a059-d6ecba6a2b22-kube-api-access-ddczn\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94503909-6235-4430-a059-d6ecba6a2b22-tmp\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94503909-6235-4430-a059-d6ecba6a2b22-manifests\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddczn\" (UniqueName: \"kubernetes.io/projected/94503909-6235-4430-a059-d6ecba6a2b22-kube-api-access-ddczn\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.342628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.213600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94503909-6235-4430-a059-d6ecba6a2b22-manifests\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.215307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94503909-6235-4430-a059-d6ecba6a2b22-tmp\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.215578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-metrics-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.215629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.215966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94503909-6235-4430-a059-d6ecba6a2b22-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.225212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddczn\" (UniqueName: \"kubernetes.io/projected/94503909-6235-4430-a059-d6ecba6a2b22-kube-api-access-ddczn\") pod \"opendatahub-operator-controller-manager-7c7d4c4566-hzgkh\" (UID: \"94503909-6235-4430-a059-d6ecba6a2b22\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.233296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.319825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:37:58.343624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.333392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:58.464109 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.464078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:58.653924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.653903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"]
Sep 08 00:37:58.656450 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:37:58.656425    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94503909_6235_4430_a059_d6ecba6a2b22.slice/crio-c7c57465db1355a4ed7fc30c7d8dea56ad32b209a33e11536a831221156c2952 WatchSource:0}: Error finding container c7c57465db1355a4ed7fc30c7d8dea56ad32b209a33e11536a831221156c2952: Status 404 returned error can't find the container with id c7c57465db1355a4ed7fc30c7d8dea56ad32b209a33e11536a831221156c2952
Sep 08 00:37:58.678089 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.678053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:58.770476 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:58.770452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:37:59.422150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:37:59.422075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh" event={"ID":"94503909-6235-4430-a059-d6ecba6a2b22","Type":"ContainerStarted","Data":"c7c57465db1355a4ed7fc30c7d8dea56ad32b209a33e11536a831221156c2952"}
Sep 08 00:38:02.111466 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:02.111422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:02.222575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:02.222537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:02.443491 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:02.443416    2578 generic.go:356] "Generic (PLEG): container finished" podID="94503909-6235-4430-a059-d6ecba6a2b22" containerID="99f8593edc76c2ba89d79a8f64ff36ad391e11488433bef11d4c288776e29ebe" exitCode=0
Sep 08 00:38:02.443645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:02.443499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh" event={"ID":"94503909-6235-4430-a059-d6ecba6a2b22","Type":"ContainerDied","Data":"99f8593edc76c2ba89d79a8f64ff36ad391e11488433bef11d4c288776e29ebe"}
Sep 08 00:38:02.444069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:02.444041    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:38:03.450417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:03.450337    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerID="6a2dc45a2ff49c3c91648fe8e389b5e9b5e20a16877a9758f6096dd17b7c4ec8" exitCode=0
Sep 08 00:38:03.450816 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:03.450422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn" event={"ID":"aa466794-bf2a-406c-a537-e62e87d0e3d2","Type":"ContainerDied","Data":"6a2dc45a2ff49c3c91648fe8e389b5e9b5e20a16877a9758f6096dd17b7c4ec8"}
Sep 08 00:38:03.452626 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:03.452604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh" event={"ID":"94503909-6235-4430-a059-d6ecba6a2b22","Type":"ContainerStarted","Data":"b2b7ba330bac5114b763a87694619527cc49b486349a8a1187f74655c35e2277"}
Sep 08 00:38:03.454112 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:03.454091    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:38:03.490840 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:03.490800    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh" podStartSLOduration=2.285965779 podStartE2EDuration="6.490787126s" totalImagesPullingTime="3.640292278s" totalInitContainerRuntime="564.529069ms" isStatefulPod=false podCreationTimestamp="2026-09-08 00:37:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:03.488421113 +0000 UTC m=+305.866794571" watchObservedRunningTime="2026-09-08 00:38:03.490787126 +0000 UTC m=+305.869160622"
Sep 08 00:38:04.459801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:04.459761    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerID="b1781e903f42626235f99d20a36339e32bc9aa3322cdfdf99c008eeb9a83b1b3" exitCode=0
Sep 08 00:38:04.460252 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:04.459853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn" event={"ID":"aa466794-bf2a-406c-a537-e62e87d0e3d2","Type":"ContainerDied","Data":"b1781e903f42626235f99d20a36339e32bc9aa3322cdfdf99c008eeb9a83b1b3"}
Sep 08 00:38:05.586079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.586053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:38:05.678083 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.678060    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xlfl\" (UniqueName: \"kubernetes.io/projected/aa466794-bf2a-406c-a537-e62e87d0e3d2-kube-api-access-2xlfl\") pod \"aa466794-bf2a-406c-a537-e62e87d0e3d2\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") "
Sep 08 00:38:05.678200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.678161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-bundle\") pod \"aa466794-bf2a-406c-a537-e62e87d0e3d2\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") "
Sep 08 00:38:05.678281 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.678266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-util\") pod \"aa466794-bf2a-406c-a537-e62e87d0e3d2\" (UID: \"aa466794-bf2a-406c-a537-e62e87d0e3d2\") "
Sep 08 00:38:05.678997 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.678970    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-bundle" (OuterVolumeSpecName: "bundle") pod "aa466794-bf2a-406c-a537-e62e87d0e3d2" (UID: "aa466794-bf2a-406c-a537-e62e87d0e3d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:38:05.680141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.680121    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa466794-bf2a-406c-a537-e62e87d0e3d2-kube-api-access-2xlfl" (OuterVolumeSpecName: "kube-api-access-2xlfl") pod "aa466794-bf2a-406c-a537-e62e87d0e3d2" (UID: "aa466794-bf2a-406c-a537-e62e87d0e3d2"). InnerVolumeSpecName "kube-api-access-2xlfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:38:05.683162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.683142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-util" (OuterVolumeSpecName: "util") pod "aa466794-bf2a-406c-a537-e62e87d0e3d2" (UID: "aa466794-bf2a-406c-a537-e62e87d0e3d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:38:05.779668 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.779614    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xlfl\" (UniqueName: \"kubernetes.io/projected/aa466794-bf2a-406c-a537-e62e87d0e3d2-kube-api-access-2xlfl\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:38:05.779668 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.779635    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:38:05.779668 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:05.779644    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa466794-bf2a-406c-a537-e62e87d0e3d2-util\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:38:06.471330 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:06.471251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn" event={"ID":"aa466794-bf2a-406c-a537-e62e87d0e3d2","Type":"ContainerDied","Data":"68c0f90ee87c2b7f0b77ac5daed99fcc7f038d8db8b76d4c4249643f817fd900"}
Sep 08 00:38:06.471330 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:06.471298    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68c0f90ee87c2b7f0b77ac5daed99fcc7f038d8db8b76d4c4249643f817fd900"
Sep 08 00:38:06.471330 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:06.471296    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tbmn"
Sep 08 00:38:06.907919 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:06.907879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:07.013923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:07.013882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:07.314743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:07.314713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:07.457811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:07.457767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:13.097849 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:13.097814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:14.292998 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:14.292961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:14.462875 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:14.462845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7c7d4c4566-hzgkh"
Sep 08 00:38:15.493347 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:15.493301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:21.332156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.332122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:21.844236 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844208    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"]
Sep 08 00:38:21.844513 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844502    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="util"
Sep 08 00:38:21.844563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844515    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="util"
Sep 08 00:38:21.844563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844540    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="pull"
Sep 08 00:38:21.844563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844545    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="pull"
Sep 08 00:38:21.844563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844552    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="extract"
Sep 08 00:38:21.844563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844557    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="extract"
Sep 08 00:38:21.844733 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.844602    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa466794-bf2a-406c-a537-e62e87d0e3d2" containerName="extract"
Sep 08 00:38:21.847182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.847167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:21.849531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.849508    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 00:38:21.849703 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.849669    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ssxq9\""
Sep 08 00:38:21.849778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.849723    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 00:38:21.861691 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.861661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"]
Sep 08 00:38:21.898593 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.898566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/3d38c9bb-af28-4974-9201-07ffc2880835-kube-api-access-b5x57\") pod \"kuadrant-operator-controller-manager-84995cf88c-z5p72\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:21.898717 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.898600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d38c9bb-af28-4974-9201-07ffc2880835-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-z5p72\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:21.999362 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.999338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/3d38c9bb-af28-4974-9201-07ffc2880835-kube-api-access-b5x57\") pod \"kuadrant-operator-controller-manager-84995cf88c-z5p72\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:21.999459 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.999368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d38c9bb-af28-4974-9201-07ffc2880835-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-z5p72\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:21.999728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:21.999712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d38c9bb-af28-4974-9201-07ffc2880835-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-z5p72\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:22.009947 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.009924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/3d38c9bb-af28-4974-9201-07ffc2880835-kube-api-access-b5x57\") pod \"kuadrant-operator-controller-manager-84995cf88c-z5p72\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:22.157454 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.157400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:22.468523 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:22.468496    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d38c9bb_af28_4974_9201_07ffc2880835.slice/crio-949db873bf3eeb74bcf2a59eeceb43960c909de0ff7cd40da2a778b109d1e6c7 WatchSource:0}: Error finding container 949db873bf3eeb74bcf2a59eeceb43960c909de0ff7cd40da2a778b109d1e6c7: Status 404 returned error can't find the container with id 949db873bf3eeb74bcf2a59eeceb43960c909de0ff7cd40da2a778b109d1e6c7
Sep 08 00:38:22.468836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.468612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"]
Sep 08 00:38:22.543625 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.543594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72" event={"ID":"3d38c9bb-af28-4974-9201-07ffc2880835","Type":"ContainerStarted","Data":"949db873bf3eeb74bcf2a59eeceb43960c909de0ff7cd40da2a778b109d1e6c7"}
Sep 08 00:38:22.794174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.794136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:22.892793 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.892762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:22.987864 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:22.987827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:23.312206 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:23.312166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:23.760336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:23.760254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:23.886258 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:23.886228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:24.159620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.159585    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"]
Sep 08 00:38:24.162804 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.162780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.165616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.165402    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 00:38:24.165752 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.165640    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 00:38:24.166786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.166616    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-svt8x\""
Sep 08 00:38:24.166786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.166624    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:38:24.173589 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.172833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"]
Sep 08 00:38:24.218047 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.218019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:24.220137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.220078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/963ee435-2bde-48e3-aa23-419ea8dd28f7-data\") pod \"postgres-69fb4594cf-b9k4q\" (UID: \"963ee435-2bde-48e3-aa23-419ea8dd28f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.220260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.220164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrh8c\" (UniqueName: \"kubernetes.io/projected/963ee435-2bde-48e3-aa23-419ea8dd28f7-kube-api-access-vrh8c\") pod \"postgres-69fb4594cf-b9k4q\" (UID: \"963ee435-2bde-48e3-aa23-419ea8dd28f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.320945 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.320912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrh8c\" (UniqueName: \"kubernetes.io/projected/963ee435-2bde-48e3-aa23-419ea8dd28f7-kube-api-access-vrh8c\") pod \"postgres-69fb4594cf-b9k4q\" (UID: \"963ee435-2bde-48e3-aa23-419ea8dd28f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.321081 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.321003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/963ee435-2bde-48e3-aa23-419ea8dd28f7-data\") pod \"postgres-69fb4594cf-b9k4q\" (UID: \"963ee435-2bde-48e3-aa23-419ea8dd28f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.321337 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.321319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/963ee435-2bde-48e3-aa23-419ea8dd28f7-data\") pod \"postgres-69fb4594cf-b9k4q\" (UID: \"963ee435-2bde-48e3-aa23-419ea8dd28f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.330319 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.330290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrh8c\" (UniqueName: \"kubernetes.io/projected/963ee435-2bde-48e3-aa23-419ea8dd28f7-kube-api-access-vrh8c\") pod \"postgres-69fb4594cf-b9k4q\" (UID: \"963ee435-2bde-48e3-aa23-419ea8dd28f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:24.478530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:24.478454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:25.020401 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.020304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:25.386293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.386057    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"]
Sep 08 00:38:25.388647 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:25.388605    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963ee435_2bde_48e3_aa23_419ea8dd28f7.slice/crio-057a02bbe06127d5c7c6606affc648bf90f76386ba95a302b3e15315f932b07f WatchSource:0}: Error finding container 057a02bbe06127d5c7c6606affc648bf90f76386ba95a302b3e15315f932b07f: Status 404 returned error can't find the container with id 057a02bbe06127d5c7c6606affc648bf90f76386ba95a302b3e15315f932b07f
Sep 08 00:38:25.404309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.404288    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"]
Sep 08 00:38:25.407801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.407785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.411362 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.411344    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 00:38:25.411457 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.411408    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-pphtt\""
Sep 08 00:38:25.412190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.412169    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 00:38:25.417608 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.417585    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Sep 08 00:38:25.420118 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.420096    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"]
Sep 08 00:38:25.534137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.534107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2f776c-1358-424d-b1ec-453000aaeead-tmp\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.534303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.534150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a2f776c-1358-424d-b1ec-453000aaeead-manifests\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.534303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.534178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2f776c-1358-424d-b1ec-453000aaeead-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.534303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.534286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpd2\" (UniqueName: \"kubernetes.io/projected/9a2f776c-1358-424d-b1ec-453000aaeead-kube-api-access-fbpd2\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.563265 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.563225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q" event={"ID":"963ee435-2bde-48e3-aa23-419ea8dd28f7","Type":"ContainerStarted","Data":"057a02bbe06127d5c7c6606affc648bf90f76386ba95a302b3e15315f932b07f"}
Sep 08 00:38:25.635494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.635468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a2f776c-1358-424d-b1ec-453000aaeead-manifests\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.635494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.635497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2f776c-1358-424d-b1ec-453000aaeead-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.635728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.635547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpd2\" (UniqueName: \"kubernetes.io/projected/9a2f776c-1358-424d-b1ec-453000aaeead-kube-api-access-fbpd2\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.635728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.635591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2f776c-1358-424d-b1ec-453000aaeead-tmp\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.635935 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.635912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a2f776c-1358-424d-b1ec-453000aaeead-manifests\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.635993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.635934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2f776c-1358-424d-b1ec-453000aaeead-tmp\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.636516 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.636497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2f776c-1358-424d-b1ec-453000aaeead-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.643851 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.643825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpd2\" (UniqueName: \"kubernetes.io/projected/9a2f776c-1358-424d-b1ec-453000aaeead-kube-api-access-fbpd2\") pod \"kserve-module-controller-manager-54765d59fd-t22vw\" (UID: \"9a2f776c-1358-424d-b1ec-453000aaeead\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:25.719814 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:25.719791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:26.000218 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:26.000142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"]
Sep 08 00:38:26.738150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:26.738112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:27.175993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.175952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:27.203184 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:27.203144    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2f776c_1358_424d_b1ec_453000aaeead.slice/crio-83b94d3487746d5bb573ba6b0509d7ba69e13ce7bb9b7f683de0dc94cec02dd5 WatchSource:0}: Error finding container 83b94d3487746d5bb573ba6b0509d7ba69e13ce7bb9b7f683de0dc94cec02dd5: Status 404 returned error can't find the container with id 83b94d3487746d5bb573ba6b0509d7ba69e13ce7bb9b7f683de0dc94cec02dd5
Sep 08 00:38:27.272892 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.272853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:27.384215 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.384182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:27.579452 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.579362    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72" event={"ID":"3d38c9bb-af28-4974-9201-07ffc2880835","Type":"ContainerStarted","Data":"1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf"}
Sep 08 00:38:27.579893 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.579844    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:27.581546 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.581517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw" event={"ID":"9a2f776c-1358-424d-b1ec-453000aaeead","Type":"ContainerStarted","Data":"83b94d3487746d5bb573ba6b0509d7ba69e13ce7bb9b7f683de0dc94cec02dd5"}
Sep 08 00:38:27.603963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.603921    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72" podStartSLOduration=1.795989598 podStartE2EDuration="6.603908967s" totalImagesPullingTime="4.807919369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:27.599774471 +0000 UTC m=+329.978147900" watchObservedRunningTime="2026-09-08 00:38:27.603908967 +0000 UTC m=+329.982282401"
Sep 08 00:38:27.755577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:27.755539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:28.584050 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.583888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:28.690845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.689252    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"]
Sep 08 00:38:28.693129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.693104    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.697519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.697472    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sxbk6\""
Sep 08 00:38:28.755561 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.755514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.764853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.764907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.764948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4t5\" (UniqueName: \"kubernetes.io/projected/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-kube-api-access-ln4t5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.765003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.765047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.765084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.765121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.765188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.765369 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.765246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.772880 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.772799    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"]
Sep 08 00:38:28.866806 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.866721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.866950 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.866905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4t5\" (UniqueName: \"kubernetes.io/projected/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-kube-api-access-ln4t5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867020 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.866966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867020 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.867011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.867047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867818 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.867202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867818 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.867253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867818 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.867309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.867818 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.867376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.868391 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.868362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.869075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.868623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.869075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.868729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.869246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.869101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.869246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.869147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.872271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.872227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.876763 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.874107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.885554 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.885509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4t5\" (UniqueName: \"kubernetes.io/projected/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-kube-api-access-ln4t5\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.894448 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.894407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec363603-2e3e-4fe7-bf3d-df6f5c902d7c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2\" (UID: \"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:28.982711 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:28.982367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:29.007873 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:29.007228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:29.359323 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:29.359258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:29.770401 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:29.770318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:30.776564 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:30.776525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:30.849073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:30.849037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:31.173237 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:31.173211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:31.281521 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:31.281487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:31.502788 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:31.502699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:32.158079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.158052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"]
Sep 08 00:38:32.159878 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:32.159853    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec363603_2e3e_4fe7_bf3d_df6f5c902d7c.slice/crio-fd661f3ca02c90e85406847be7e9a87ce0f814e7f92dd0da7f6009d79a7e8896 WatchSource:0}: Error finding container fd661f3ca02c90e85406847be7e9a87ce0f814e7f92dd0da7f6009d79a7e8896: Status 404 returned error can't find the container with id fd661f3ca02c90e85406847be7e9a87ce0f814e7f92dd0da7f6009d79a7e8896
Sep 08 00:38:32.161999 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.161969    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:38:32.162075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.162029    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:38:32.162075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.162058    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:38:32.232325 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.232294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:32.373386 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.373347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:32.529791 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.529712    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gvj77"]
Sep 08 00:38:32.533141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.533123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.536239 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.536218    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ff9qj\""
Sep 08 00:38:32.536449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.536429    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 00:38:32.537269 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.537255    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 00:38:32.545608 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.545585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gvj77"]
Sep 08 00:38:32.611648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.611612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2" event={"ID":"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c","Type":"ContainerStarted","Data":"52d19dfe5b8e3434fe27ade0541305816e853f05d2465e4757e2e737ab2f18f0"}
Sep 08 00:38:32.611820 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.611670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2" event={"ID":"ec363603-2e3e-4fe7-bf3d-df6f5c902d7c","Type":"ContainerStarted","Data":"fd661f3ca02c90e85406847be7e9a87ce0f814e7f92dd0da7f6009d79a7e8896"}
Sep 08 00:38:32.613447 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.613421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw" event={"ID":"9a2f776c-1358-424d-b1ec-453000aaeead","Type":"ContainerStarted","Data":"c1e46c8aaa5fa8fcd62c6a16356b1d642e26f996dc7986249908adf236809aa3"}
Sep 08 00:38:32.613566 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.613523    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:32.615120 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.615099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q" event={"ID":"963ee435-2bde-48e3-aa23-419ea8dd28f7","Type":"ContainerStarted","Data":"4e3c4ed7789c09fd6833839aa0ed2838b9d45ebcda694e8f1c2dc22f6ce22201"}
Sep 08 00:38:32.615278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.615262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:32.637632 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.637587    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2" podStartSLOduration=4.637574612 podStartE2EDuration="4.637574612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:32.635950441 +0000 UTC m=+335.014323875" watchObservedRunningTime="2026-09-08 00:38:32.637574612 +0000 UTC m=+335.015948036"
Sep 08 00:38:32.656152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.656117    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q" podStartSLOduration=2.084383994 podStartE2EDuration="8.656101183s" totalImagesPullingTime="6.571717189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:32.655422359 +0000 UTC m=+335.033795791" watchObservedRunningTime="2026-09-08 00:38:32.656101183 +0000 UTC m=+335.034474616"
Sep 08 00:38:32.673329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.673295    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw" podStartSLOduration=2.995274758 podStartE2EDuration="7.673283928s" totalImagesPullingTime="4.67800917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:32.672098368 +0000 UTC m=+335.050471801" watchObservedRunningTime="2026-09-08 00:38:32.673283928 +0000 UTC m=+335.051657360"
Sep 08 00:38:32.702447 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.702418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjl4\" (UniqueName: \"kubernetes.io/projected/754ba298-0fac-47de-8422-01ab8d514142-kube-api-access-gwjl4\") pod \"cert-manager-webhook-6486ffd997-gvj77\" (UID: \"754ba298-0fac-47de-8422-01ab8d514142\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.702645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.702617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/754ba298-0fac-47de-8422-01ab8d514142-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gvj77\" (UID: \"754ba298-0fac-47de-8422-01ab8d514142\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.803910 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.803887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/754ba298-0fac-47de-8422-01ab8d514142-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gvj77\" (UID: \"754ba298-0fac-47de-8422-01ab8d514142\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.804034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.803945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjl4\" (UniqueName: \"kubernetes.io/projected/754ba298-0fac-47de-8422-01ab8d514142-kube-api-access-gwjl4\") pod \"cert-manager-webhook-6486ffd997-gvj77\" (UID: \"754ba298-0fac-47de-8422-01ab8d514142\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.813352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.813325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/754ba298-0fac-47de-8422-01ab8d514142-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gvj77\" (UID: \"754ba298-0fac-47de-8422-01ab8d514142\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.813429 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.813400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjl4\" (UniqueName: \"kubernetes.io/projected/754ba298-0fac-47de-8422-01ab8d514142-kube-api-access-gwjl4\") pod \"cert-manager-webhook-6486ffd997-gvj77\" (UID: \"754ba298-0fac-47de-8422-01ab8d514142\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:32.843152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:32.843134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:33.008027 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.007989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:33.013453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.013425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:33.115909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.115840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gvj77"]
Sep 08 00:38:33.119214 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:33.119188    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod754ba298_0fac_47de_8422_01ab8d514142.slice/crio-fee513dc72bb1db251f02e65eee6920d4874f9525eaf2fd0fbb82fbb070a254e WatchSource:0}: Error finding container fee513dc72bb1db251f02e65eee6920d4874f9525eaf2fd0fbb82fbb070a254e: Status 404 returned error can't find the container with id fee513dc72bb1db251f02e65eee6920d4874f9525eaf2fd0fbb82fbb070a254e
Sep 08 00:38:33.621394 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.621357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77" event={"ID":"754ba298-0fac-47de-8422-01ab8d514142","Type":"ContainerStarted","Data":"fee513dc72bb1db251f02e65eee6920d4874f9525eaf2fd0fbb82fbb070a254e"}
Sep 08 00:38:33.621801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.621613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:33.622659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.622638    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2"
Sep 08 00:38:33.771248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:33.771215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:34.692023 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:34.691980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:34.861501 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:34.861444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:37.498016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:37.497977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:37.634377 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:37.634319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:37.727031 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:37.726986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:37.792047 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:37.792016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:38.590472 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.590440    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:38.648235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.648198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77" event={"ID":"754ba298-0fac-47de-8422-01ab8d514142","Type":"ContainerStarted","Data":"98ba8b379affb05af744a900e5fb66875db2a75bd4401148edce430533e1b56a"}
Sep 08 00:38:38.648410 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.648266    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:38.652030 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.652005    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b9k4q"
Sep 08 00:38:38.667188 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.667142    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77" podStartSLOduration=1.935079241 podStartE2EDuration="6.667126994s" totalImagesPullingTime="4.732047753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:38.66578338 +0000 UTC m=+341.044156814" watchObservedRunningTime="2026-09-08 00:38:38.667126994 +0000 UTC m=+341.045500426"
Sep 08 00:38:38.715314 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.715287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:38.814084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.814053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:38.918985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.918913    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"]
Sep 08 00:38:38.921178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.921157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:38.924038 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.924020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-px4vc\""
Sep 08 00:38:38.933725 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.933705    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"]
Sep 08 00:38:38.963135 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.963112    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"]
Sep 08 00:38:38.965325 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.965309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:38.981530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:38.981509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"]
Sep 08 00:38:39.061859 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.061825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6822r\" (UniqueName: \"kubernetes.io/projected/ac5afba0-dbaf-44d6-83c1-8cef96c7f010-kube-api-access-6822r\") pod \"cert-manager-cainjector-559cdd8c87-qt8wn\" (UID: \"ac5afba0-dbaf-44d6-83c1-8cef96c7f010\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.062026 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.061865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a39ea65-eecc-422c-897f-d155f8f1f71c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-rgbxb\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.062099 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.062029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac5afba0-dbaf-44d6-83c1-8cef96c7f010-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qt8wn\" (UID: \"ac5afba0-dbaf-44d6-83c1-8cef96c7f010\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.062099 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.062090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9nd9\" (UniqueName: \"kubernetes.io/projected/9a39ea65-eecc-422c-897f-d155f8f1f71c-kube-api-access-g9nd9\") pod \"kuadrant-operator-controller-manager-7456d9997c-rgbxb\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.163072 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.163042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9nd9\" (UniqueName: \"kubernetes.io/projected/9a39ea65-eecc-422c-897f-d155f8f1f71c-kube-api-access-g9nd9\") pod \"kuadrant-operator-controller-manager-7456d9997c-rgbxb\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.163200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.163086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6822r\" (UniqueName: \"kubernetes.io/projected/ac5afba0-dbaf-44d6-83c1-8cef96c7f010-kube-api-access-6822r\") pod \"cert-manager-cainjector-559cdd8c87-qt8wn\" (UID: \"ac5afba0-dbaf-44d6-83c1-8cef96c7f010\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.163200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.163115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a39ea65-eecc-422c-897f-d155f8f1f71c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-rgbxb\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.163320 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.163210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac5afba0-dbaf-44d6-83c1-8cef96c7f010-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qt8wn\" (UID: \"ac5afba0-dbaf-44d6-83c1-8cef96c7f010\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.163531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.163507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a39ea65-eecc-422c-897f-d155f8f1f71c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-rgbxb\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.173742 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.173670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6822r\" (UniqueName: \"kubernetes.io/projected/ac5afba0-dbaf-44d6-83c1-8cef96c7f010-kube-api-access-6822r\") pod \"cert-manager-cainjector-559cdd8c87-qt8wn\" (UID: \"ac5afba0-dbaf-44d6-83c1-8cef96c7f010\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.173833 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.173816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac5afba0-dbaf-44d6-83c1-8cef96c7f010-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qt8wn\" (UID: \"ac5afba0-dbaf-44d6-83c1-8cef96c7f010\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.174032 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.174011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9nd9\" (UniqueName: \"kubernetes.io/projected/9a39ea65-eecc-422c-897f-d155f8f1f71c-kube-api-access-g9nd9\") pod \"kuadrant-operator-controller-manager-7456d9997c-rgbxb\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.230076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.230053    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"
Sep 08 00:38:39.280234 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.279935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.497640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.497567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn"]
Sep 08 00:38:39.499723 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:39.499678    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac5afba0_dbaf_44d6_83c1_8cef96c7f010.slice/crio-a75c26ca0eaa32123d296dcd61ca61ad5251cd8b4d445b4fdd688af28ad94f98 WatchSource:0}: Error finding container a75c26ca0eaa32123d296dcd61ca61ad5251cd8b4d445b4fdd688af28ad94f98: Status 404 returned error can't find the container with id a75c26ca0eaa32123d296dcd61ca61ad5251cd8b4d445b4fdd688af28ad94f98
Sep 08 00:38:39.560058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.560034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"]
Sep 08 00:38:39.561562 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:38:39.561540    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a39ea65_eecc_422c_897f_d155f8f1f71c.slice/crio-e91cf0ce66d16e3dfed2e72697e3ed817006311ded20f593660d24f3a0b7d1b1 WatchSource:0}: Error finding container e91cf0ce66d16e3dfed2e72697e3ed817006311ded20f593660d24f3a0b7d1b1: Status 404 returned error can't find the container with id e91cf0ce66d16e3dfed2e72697e3ed817006311ded20f593660d24f3a0b7d1b1
Sep 08 00:38:39.655088 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.655055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb" event={"ID":"9a39ea65-eecc-422c-897f-d155f8f1f71c","Type":"ContainerStarted","Data":"9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1"}
Sep 08 00:38:39.655421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.655120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb" event={"ID":"9a39ea65-eecc-422c-897f-d155f8f1f71c","Type":"ContainerStarted","Data":"e91cf0ce66d16e3dfed2e72697e3ed817006311ded20f593660d24f3a0b7d1b1"}
Sep 08 00:38:39.655421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.655155    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:39.656605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.656582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn" event={"ID":"ac5afba0-dbaf-44d6-83c1-8cef96c7f010","Type":"ContainerStarted","Data":"3958db4532b122949e6f78d35a7dacc2f99740454c9797c4a6fe070afb5c4d95"}
Sep 08 00:38:39.656698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.656613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn" event={"ID":"ac5afba0-dbaf-44d6-83c1-8cef96c7f010","Type":"ContainerStarted","Data":"a75c26ca0eaa32123d296dcd61ca61ad5251cd8b4d445b4fdd688af28ad94f98"}
Sep 08 00:38:39.681909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.681831    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb" podStartSLOduration=1.6818123520000001 podStartE2EDuration="1.681812352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:39.679816752 +0000 UTC m=+342.058190198" watchObservedRunningTime="2026-09-08 00:38:39.681812352 +0000 UTC m=+342.060185786"
Sep 08 00:38:39.696221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:39.696176    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt8wn" podStartSLOduration=1.696158673 podStartE2EDuration="1.696158673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:39.695902383 +0000 UTC m=+342.074275816" watchObservedRunningTime="2026-09-08 00:38:39.696158673 +0000 UTC m=+342.074532106"
Sep 08 00:38:40.503246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:40.503212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:40.603295 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:40.603267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:42.244380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:42.244347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:43.146305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:43.146262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:43.303392 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:43.303347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:43.398063 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:43.397985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:43.499024 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:43.498991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:43.610962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:43.610933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:44.289973 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:44.289941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:44.395418 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:44.395386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:44.658893 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:44.658862    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gvj77"
Sep 08 00:38:45.946200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:45.946167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:46.046141 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:46.046102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:50.529916 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:50.529866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:50.630280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:50.630199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:50.663566 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:50.663533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:38:50.725187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:50.725152    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"]
Sep 08 00:38:50.725414 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:50.725389    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72" podUID="3d38c9bb-af28-4974-9201-07ffc2880835" containerName="manager" containerID="cri-o://1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf" gracePeriod=10
Sep 08 00:38:50.973643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:50.973617    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:51.065161 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.065137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d38c9bb-af28-4974-9201-07ffc2880835-extensions-socket-volume\") pod \"3d38c9bb-af28-4974-9201-07ffc2880835\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") "
Sep 08 00:38:51.065286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.065245    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/3d38c9bb-af28-4974-9201-07ffc2880835-kube-api-access-b5x57\") pod \"3d38c9bb-af28-4974-9201-07ffc2880835\" (UID: \"3d38c9bb-af28-4974-9201-07ffc2880835\") "
Sep 08 00:38:51.065659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.065631    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d38c9bb-af28-4974-9201-07ffc2880835-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3d38c9bb-af28-4974-9201-07ffc2880835" (UID: "3d38c9bb-af28-4974-9201-07ffc2880835"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:38:51.067286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.067263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d38c9bb-af28-4974-9201-07ffc2880835-kube-api-access-b5x57" (OuterVolumeSpecName: "kube-api-access-b5x57") pod "3d38c9bb-af28-4974-9201-07ffc2880835" (UID: "3d38c9bb-af28-4974-9201-07ffc2880835"). InnerVolumeSpecName "kube-api-access-b5x57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:38:51.166811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.166751    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/3d38c9bb-af28-4974-9201-07ffc2880835-kube-api-access-b5x57\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:38:51.166811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.166774    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d38c9bb-af28-4974-9201-07ffc2880835-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:38:51.717783 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.717738    2578 generic.go:356] "Generic (PLEG): container finished" podID="3d38c9bb-af28-4974-9201-07ffc2880835" containerID="1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf" exitCode=0
Sep 08 00:38:51.718268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.717788    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"
Sep 08 00:38:51.718268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.717826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72" event={"ID":"3d38c9bb-af28-4974-9201-07ffc2880835","Type":"ContainerDied","Data":"1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf"}
Sep 08 00:38:51.718268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.717886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72" event={"ID":"3d38c9bb-af28-4974-9201-07ffc2880835","Type":"ContainerDied","Data":"949db873bf3eeb74bcf2a59eeceb43960c909de0ff7cd40da2a778b109d1e6c7"}
Sep 08 00:38:51.718268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.717912    2578 scope.go:117] "RemoveContainer" containerID="1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf"
Sep 08 00:38:51.727904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.727696    2578 scope.go:117] "RemoveContainer" containerID="1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf"
Sep 08 00:38:51.728039 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:38:51.728016    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf\": container with ID starting with 1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf not found: ID does not exist" containerID="1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf"
Sep 08 00:38:51.728078 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.728048    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf"} err="failed to get container status \"1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf\": rpc error: code = NotFound desc = could not find container \"1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf\": container with ID starting with 1ccf7299f2d0497032760d4449b4441119c0597c1aec37fb4751c499355d6fbf not found: ID does not exist"
Sep 08 00:38:51.741216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.741193    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"]
Sep 08 00:38:51.746922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:51.746901    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-z5p72"]
Sep 08 00:38:52.057283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:52.057255    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d38c9bb-af28-4974-9201-07ffc2880835" path="/var/lib/kubelet/pods/3d38c9bb-af28-4974-9201-07ffc2880835/volumes"
Sep 08 00:38:53.509426 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:53.509393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:53.610902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:53.610872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:53.624097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:53.624070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-t22vw"
Sep 08 00:38:58.705764 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:58.705708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:58.806816 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:58.806775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:59.149829 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:59.149796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:59.203434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:59.203397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:59.315894 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:59.315861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:38:59.415892 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:38:59.415797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:02.876731 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:02.876654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:05.799961 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:05.799925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:05.904535 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:05.904495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:12.343269 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.343231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:12.439597 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.439564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:12.770872 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.770779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:12.772288 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.772264    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:12.772655 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.772640    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d38c9bb-af28-4974-9201-07ffc2880835" containerName="manager"
Sep 08 00:39:12.772655 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.772655    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d38c9bb-af28-4974-9201-07ffc2880835" containerName="manager"
Sep 08 00:39:12.772771 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.772731    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d38c9bb-af28-4974-9201-07ffc2880835" containerName="manager"
Sep 08 00:39:12.798801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.798751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:12.798919 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.798878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:12.801613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.801589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dhth8\""
Sep 08 00:39:12.801766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.801720    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 00:39:12.880413 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.880379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:12.883257 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.883204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:12.947623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.947593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4x2n\" (UniqueName: \"kubernetes.io/projected/93caf825-c41d-4217-b5c1-399ada497e3e-kube-api-access-c4x2n\") pod \"limitador-limitador-859c4d96d6-fst5s\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:12.947758 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.947671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93caf825-c41d-4217-b5c1-399ada497e3e-config-file\") pod \"limitador-limitador-859c4d96d6-fst5s\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:12.979807 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:12.979775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:13.048773 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.048746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93caf825-c41d-4217-b5c1-399ada497e3e-config-file\") pod \"limitador-limitador-859c4d96d6-fst5s\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:13.048884 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.048796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4x2n\" (UniqueName: \"kubernetes.io/projected/93caf825-c41d-4217-b5c1-399ada497e3e-kube-api-access-c4x2n\") pod \"limitador-limitador-859c4d96d6-fst5s\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:13.049328 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.049309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93caf825-c41d-4217-b5c1-399ada497e3e-config-file\") pod \"limitador-limitador-859c4d96d6-fst5s\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:13.056498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.056468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4x2n\" (UniqueName: \"kubernetes.io/projected/93caf825-c41d-4217-b5c1-399ada497e3e-kube-api-access-c4x2n\") pod \"limitador-limitador-859c4d96d6-fst5s\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:13.109665 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.109635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:13.381168 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.381139    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:13.385867 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:13.385830    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93caf825_c41d_4217_b5c1_399ada497e3e.slice/crio-3042a447d637d33474348bacdc7f14e70a194aef5380f330f2cedbf79c265388 WatchSource:0}: Error finding container 3042a447d637d33474348bacdc7f14e70a194aef5380f330f2cedbf79c265388: Status 404 returned error can't find the container with id 3042a447d637d33474348bacdc7f14e70a194aef5380f330f2cedbf79c265388
Sep 08 00:39:13.639970 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.639894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:13.724627 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.724589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:13.836650 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:13.836617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s" event={"ID":"93caf825-c41d-4217-b5c1-399ada497e3e","Type":"ContainerStarted","Data":"3042a447d637d33474348bacdc7f14e70a194aef5380f330f2cedbf79c265388"}
Sep 08 00:39:15.367104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:15.367065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:15.513302 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:15.513180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:15.849324 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:15.849292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s" event={"ID":"93caf825-c41d-4217-b5c1-399ada497e3e","Type":"ContainerStarted","Data":"9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839"}
Sep 08 00:39:15.849558 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:15.849429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:15.870544 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:15.870488    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s" podStartSLOduration=2.065885516 podStartE2EDuration="3.870473123s" totalImagesPullingTime="1.804587607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:15.867750888 +0000 UTC m=+378.246124321" watchObservedRunningTime="2026-09-08 00:39:15.870473123 +0000 UTC m=+378.248846560"
Sep 08 00:39:17.523473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:17.523434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:17.620939 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:17.620901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:18.741479 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:18.741438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:18.930113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:18.930079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:19.461547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.461514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:19.669565 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.669524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:19.809363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.809308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:19.861078 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.861049    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"]
Sep 08 00:39:19.867415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.867397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:19.870837 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.870815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 00:39:19.871909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.871888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 00:39:19.871909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.871899    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gnd2h\""
Sep 08 00:39:19.886529 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:19.886505    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"]
Sep 08 00:39:20.013000 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.012966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqctf\" (UniqueName: \"kubernetes.io/projected/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-kube-api-access-dqctf\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.013161 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.013015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-maas-api-tls\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.013161 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.013088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-metrics-certs\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.013161 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.013127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-openshift-service-ca\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.114107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.114028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqctf\" (UniqueName: \"kubernetes.io/projected/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-kube-api-access-dqctf\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.114107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.114084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-maas-api-tls\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.114341 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.114123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-metrics-certs\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.114341 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.114151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-openshift-service-ca\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.114890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.114864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-openshift-service-ca\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.116607 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.116580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-metrics-certs\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.116740 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.116626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-maas-api-tls\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.126908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.126880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqctf\" (UniqueName: \"kubernetes.io/projected/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-kube-api-access-dqctf\") pod \"maas-api-768897d8b6-4cnzg\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") " pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.178510 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.178481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:20.474366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.474287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"]
Sep 08 00:39:20.481128 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:20.480937    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e686ba_5bc1_4d52_9e1b_94c0ad62d0e2.slice/crio-e1eb3dff69164003a77184f9c70aa7bd8265c2cdd0fe01bbd708f98dc4dc5bf1 WatchSource:0}: Error finding container e1eb3dff69164003a77184f9c70aa7bd8265c2cdd0fe01bbd708f98dc4dc5bf1: Status 404 returned error can't find the container with id e1eb3dff69164003a77184f9c70aa7bd8265c2cdd0fe01bbd708f98dc4dc5bf1
Sep 08 00:39:20.486356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.486095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:20.613881 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.613841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:20.695570 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.695541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:20.698131 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.698107    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:20.747890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.747824    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-np5lm"]
Sep 08 00:39:20.752740 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.752719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:20.760284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.760263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 00:39:20.760380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.760303    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n98qv\""
Sep 08 00:39:20.781429 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.781409    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-np5lm"]
Sep 08 00:39:20.878079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.878040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg" event={"ID":"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2","Type":"ContainerStarted","Data":"e1eb3dff69164003a77184f9c70aa7bd8265c2cdd0fe01bbd708f98dc4dc5bf1"}
Sep 08 00:39:20.923040 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.923004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9kk5\" (UniqueName: \"kubernetes.io/projected/6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf-kube-api-access-b9kk5\") pod \"payload-processing-5b54b7fbb7-np5lm\" (UID: \"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:20.923206 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:20.923057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-np5lm\" (UID: \"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:21.023652 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.023567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9kk5\" (UniqueName: \"kubernetes.io/projected/6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf-kube-api-access-b9kk5\") pod \"payload-processing-5b54b7fbb7-np5lm\" (UID: \"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:21.023826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.023653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-np5lm\" (UID: \"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:21.024496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.024471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-np5lm\" (UID: \"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:21.037021 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.036995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9kk5\" (UniqueName: \"kubernetes.io/projected/6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf-kube-api-access-b9kk5\") pod \"payload-processing-5b54b7fbb7-np5lm\" (UID: \"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:21.063195 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.063173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:21.375305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.375278    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-np5lm"]
Sep 08 00:39:21.376609 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:21.376580    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efa673d_1a39_46e7_ae43_c6bb0fb0d5bf.slice/crio-74a95c1a892fd5d3b518823f867a1a25d5358201579d68b55ce55acb8b036452 WatchSource:0}: Error finding container 74a95c1a892fd5d3b518823f867a1a25d5358201579d68b55ce55acb8b036452: Status 404 returned error can't find the container with id 74a95c1a892fd5d3b518823f867a1a25d5358201579d68b55ce55acb8b036452
Sep 08 00:39:21.885162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:21.885124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm" event={"ID":"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf","Type":"ContainerStarted","Data":"74a95c1a892fd5d3b518823f867a1a25d5358201579d68b55ce55acb8b036452"}
Sep 08 00:39:22.906698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:22.906650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg" event={"ID":"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2","Type":"ContainerStarted","Data":"7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb"}
Sep 08 00:39:22.907140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:22.907026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:22.933181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:22.933129    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg" podStartSLOduration=2.4792726099999998 podStartE2EDuration="3.933110416s" totalImagesPullingTime="1.453837806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:22.933066017 +0000 UTC m=+385.311439578" watchObservedRunningTime="2026-09-08 00:39:22.933110416 +0000 UTC m=+385.311483851"
Sep 08 00:39:23.016406 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.016316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.130615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.130578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.305268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.305230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.334704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.334197    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"]
Sep 08 00:39:23.344711 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.342067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:23.347238 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.347043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-clcml\""
Sep 08 00:39:23.347972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.347952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 00:39:23.361704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.359150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"]
Sep 08 00:39:23.417463 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.417431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-xqsrp"]
Sep 08 00:39:23.437371 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.437338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.446106 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.442209    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2qmq4\""
Sep 08 00:39:23.446106 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.442704    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 00:39:23.447395 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.447372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-xqsrp"]
Sep 08 00:39:23.451900 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.451324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fddc769e-7610-43ee-b473-88fa32c73f0b-cert\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:23.451900 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.451385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgc2s\" (UniqueName: \"kubernetes.io/projected/fddc769e-7610-43ee-b473-88fa32c73f0b-kube-api-access-pgc2s\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:23.517819 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.517789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.553054 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.553026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcbb8\" (UniqueName: \"kubernetes.io/projected/8ebbdc0b-0937-48f0-8458-a8f848c66ed0-kube-api-access-bcbb8\") pod \"model-serving-api-7d6487fcc8-xqsrp\" (UID: \"8ebbdc0b-0937-48f0-8458-a8f848c66ed0\") " pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.553365 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.553338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fddc769e-7610-43ee-b473-88fa32c73f0b-cert\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:23.553486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.553389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebbdc0b-0937-48f0-8458-a8f848c66ed0-tls-certs\") pod \"model-serving-api-7d6487fcc8-xqsrp\" (UID: \"8ebbdc0b-0937-48f0-8458-a8f848c66ed0\") " pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.553486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.553462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgc2s\" (UniqueName: \"kubernetes.io/projected/fddc769e-7610-43ee-b473-88fa32c73f0b-kube-api-access-pgc2s\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:23.553597 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:39:23.553515    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 00:39:23.553597 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:39:23.553593    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fddc769e-7610-43ee-b473-88fa32c73f0b-cert podName:fddc769e-7610-43ee-b473-88fa32c73f0b nodeName:}" failed. No retries permitted until 2026-09-08 00:39:24.053562136 +0000 UTC m=+386.431935561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fddc769e-7610-43ee-b473-88fa32c73f0b-cert") pod "llmisvc-controller-manager-7d548556bc-jh7pn" (UID: "fddc769e-7610-43ee-b473-88fa32c73f0b") : secret "llmisvc-webhook-server-cert" not found
Sep 08 00:39:23.567515 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.567348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgc2s\" (UniqueName: \"kubernetes.io/projected/fddc769e-7610-43ee-b473-88fa32c73f0b-kube-api-access-pgc2s\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:23.634343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.634311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.654379 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.654331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebbdc0b-0937-48f0-8458-a8f848c66ed0-tls-certs\") pod \"model-serving-api-7d6487fcc8-xqsrp\" (UID: \"8ebbdc0b-0937-48f0-8458-a8f848c66ed0\") " pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.655033 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.655009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcbb8\" (UniqueName: \"kubernetes.io/projected/8ebbdc0b-0937-48f0-8458-a8f848c66ed0-kube-api-access-bcbb8\") pod \"model-serving-api-7d6487fcc8-xqsrp\" (UID: \"8ebbdc0b-0937-48f0-8458-a8f848c66ed0\") " pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.660475 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.660400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebbdc0b-0937-48f0-8458-a8f848c66ed0-tls-certs\") pod \"model-serving-api-7d6487fcc8-xqsrp\" (UID: \"8ebbdc0b-0937-48f0-8458-a8f848c66ed0\") " pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.667346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.667326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcbb8\" (UniqueName: \"kubernetes.io/projected/8ebbdc0b-0937-48f0-8458-a8f848c66ed0-kube-api-access-bcbb8\") pod \"model-serving-api-7d6487fcc8-xqsrp\" (UID: \"8ebbdc0b-0937-48f0-8458-a8f848c66ed0\") " pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.756476 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.756435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.767956 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.767929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:23.852093 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.852059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:23.958059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:23.958006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:24.058704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.058657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fddc769e-7610-43ee-b473-88fa32c73f0b-cert\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:24.060910 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.060890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fddc769e-7610-43ee-b473-88fa32c73f0b-cert\") pod \"llmisvc-controller-manager-7d548556bc-jh7pn\" (UID: \"fddc769e-7610-43ee-b473-88fa32c73f0b\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:24.137108 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.137085    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-xqsrp"]
Sep 08 00:39:24.137781 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:24.137747    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebbdc0b_0937_48f0_8458_a8f848c66ed0.slice/crio-41b7a2cefe7227e7ededab8d73ca42aefdb7fb0a1f2fd2d08be25b61943c3cd7 WatchSource:0}: Error finding container 41b7a2cefe7227e7ededab8d73ca42aefdb7fb0a1f2fd2d08be25b61943c3cd7: Status 404 returned error can't find the container with id 41b7a2cefe7227e7ededab8d73ca42aefdb7fb0a1f2fd2d08be25b61943c3cd7
Sep 08 00:39:24.265044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.265008    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:24.561364 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.561332    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"]
Sep 08 00:39:24.562808 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:24.562773    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfddc769e_7610_43ee_b473_88fa32c73f0b.slice/crio-cf570f0ed7def6b1b7b127e72242507c4e99d729a303e59119dd7809caa82ba1 WatchSource:0}: Error finding container cf570f0ed7def6b1b7b127e72242507c4e99d729a303e59119dd7809caa82ba1: Status 404 returned error can't find the container with id cf570f0ed7def6b1b7b127e72242507c4e99d729a303e59119dd7809caa82ba1
Sep 08 00:39:24.671316 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.671269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:24.768082 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.768041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:24.899770 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.899623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:24.922056 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.922023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm" event={"ID":"6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf","Type":"ContainerStarted","Data":"1a7e4e168dc904d1f6b1f5ec970a53fc88850ad7c67f472451d6376a374d2c7d"}
Sep 08 00:39:24.922256 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.922238    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:24.923401 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.923381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn" event={"ID":"fddc769e-7610-43ee-b473-88fa32c73f0b","Type":"ContainerStarted","Data":"cf570f0ed7def6b1b7b127e72242507c4e99d729a303e59119dd7809caa82ba1"}
Sep 08 00:39:24.924541 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.924521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp" event={"ID":"8ebbdc0b-0937-48f0-8458-a8f848c66ed0","Type":"ContainerStarted","Data":"41b7a2cefe7227e7ededab8d73ca42aefdb7fb0a1f2fd2d08be25b61943c3cd7"}
Sep 08 00:39:24.951416 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:24.951374    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm" podStartSLOduration=2.408522033 podStartE2EDuration="4.951361029s" totalImagesPullingTime="2.542838996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:24.948842646 +0000 UTC m=+387.327216089" watchObservedRunningTime="2026-09-08 00:39:24.951361029 +0000 UTC m=+387.329734461"
Sep 08 00:39:25.099303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:25.099259    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:26.939674 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:26.939504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp" event={"ID":"8ebbdc0b-0937-48f0-8458-a8f848c66ed0","Type":"ContainerStarted","Data":"a9316bb5613f9828c092f73fa517bad5972af557ef1846890643e2e2dcfaf620"}
Sep 08 00:39:26.939674 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:26.939612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:26.958797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:26.958747    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp" podStartSLOduration=1.932985787 podStartE2EDuration="3.958731499s" totalImagesPullingTime="2.025745712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:26.955973408 +0000 UTC m=+389.334346863" watchObservedRunningTime="2026-09-08 00:39:26.958731499 +0000 UTC m=+389.337104933"
Sep 08 00:39:27.946500 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:27.946451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn" event={"ID":"fddc769e-7610-43ee-b473-88fa32c73f0b","Type":"ContainerStarted","Data":"518d96454cf18cc9487e25f444d96e67406114ae74bd1d5a48958b37da1c4df0"}
Sep 08 00:39:27.946969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:27.946640    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:39:27.964833 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:27.964785    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn" podStartSLOduration=2.18145853 podStartE2EDuration="4.964766887s" totalImagesPullingTime="2.783308357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:27.962490021 +0000 UTC m=+390.340863456" watchObservedRunningTime="2026-09-08 00:39:27.964766887 +0000 UTC m=+390.343140319"
Sep 08 00:39:28.920519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:28.920487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:29.288604 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.288498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:29.400656 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.400607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:29.636738 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.636705    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"]
Sep 08 00:39:29.640919 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.640899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.651351 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.651326    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"]
Sep 08 00:39:29.736082 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.736053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a311d76d-d02d-454b-a761-c77b609cb02a-openshift-service-ca\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.736228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.736089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-metrics-certs\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.736228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.736166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-maas-api-tls\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.736228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.736209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56vmt\" (UniqueName: \"kubernetes.io/projected/a311d76d-d02d-454b-a761-c77b609cb02a-kube-api-access-56vmt\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.822719 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.822642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:29.837202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.837179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56vmt\" (UniqueName: \"kubernetes.io/projected/a311d76d-d02d-454b-a761-c77b609cb02a-kube-api-access-56vmt\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.837298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.837239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a311d76d-d02d-454b-a761-c77b609cb02a-openshift-service-ca\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.837298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.837256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-metrics-certs\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.837420 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.837303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-maas-api-tls\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.837982 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.837957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a311d76d-d02d-454b-a761-c77b609cb02a-openshift-service-ca\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.839908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.839882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-maas-api-tls\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.839989 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.839911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-metrics-certs\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.845860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.845836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56vmt\" (UniqueName: \"kubernetes.io/projected/a311d76d-d02d-454b-a761-c77b609cb02a-kube-api-access-56vmt\") pod \"maas-api-6dcd549895-vszfm\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") " pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:29.954522 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:29.954454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:30.256445 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.256411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"]
Sep 08 00:39:30.257792 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:30.257760    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda311d76d_d02d_454b_a761_c77b609cb02a.slice/crio-2f2c93eb453868b98c9bd25f25a69dea99531dda4c67ee35e7431177d72966a2 WatchSource:0}: Error finding container 2f2c93eb453868b98c9bd25f25a69dea99531dda4c67ee35e7431177d72966a2: Status 404 returned error can't find the container with id 2f2c93eb453868b98c9bd25f25a69dea99531dda4c67ee35e7431177d72966a2
Sep 08 00:39:30.771367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.771290    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:30.771796 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.771482    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s" podUID="93caf825-c41d-4217-b5c1-399ada497e3e" containerName="limitador" containerID="cri-o://9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839" gracePeriod=30
Sep 08 00:39:30.966430 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.966397    2578 generic.go:356] "Generic (PLEG): container finished" podID="edcd4584-56dc-4162-9f47-36784db854cc" containerID="a15689c7050aab59b20c713978303ad7924c685d19a60c932b4c20ea06bc0568" exitCode=0
Sep 08 00:39:30.966595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.966474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" event={"ID":"edcd4584-56dc-4162-9f47-36784db854cc","Type":"ContainerDied","Data":"a15689c7050aab59b20c713978303ad7924c685d19a60c932b4c20ea06bc0568"}
Sep 08 00:39:30.966973 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.966955    2578 scope.go:117] "RemoveContainer" containerID="a15689c7050aab59b20c713978303ad7924c685d19a60c932b4c20ea06bc0568"
Sep 08 00:39:30.968034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.968013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" event={"ID":"a311d76d-d02d-454b-a761-c77b609cb02a","Type":"ContainerStarted","Data":"3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125"}
Sep 08 00:39:30.968124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.968057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" event={"ID":"a311d76d-d02d-454b-a761-c77b609cb02a","Type":"ContainerStarted","Data":"2f2c93eb453868b98c9bd25f25a69dea99531dda4c67ee35e7431177d72966a2"}
Sep 08 00:39:30.968124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.968091    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:30.968124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.968010    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:39:30.968232 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.968195    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:39:30.968270 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:30.968248    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:39:31.006015 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.005973    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" podStartSLOduration=1.719840544 podStartE2EDuration="2.005958335s" totalImagesPullingTime="286.117791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:31.00388688 +0000 UTC m=+393.382260326" watchObservedRunningTime="2026-09-08 00:39:31.005958335 +0000 UTC m=+393.384331767"
Sep 08 00:39:31.328109 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.328083    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:39:31.335882 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.335865    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:31.352879 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.352780    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4x2n\" (UniqueName: \"kubernetes.io/projected/93caf825-c41d-4217-b5c1-399ada497e3e-kube-api-access-c4x2n\") pod \"93caf825-c41d-4217-b5c1-399ada497e3e\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") "
Sep 08 00:39:31.353283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.353252    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93caf825-c41d-4217-b5c1-399ada497e3e-config-file\") pod \"93caf825-c41d-4217-b5c1-399ada497e3e\" (UID: \"93caf825-c41d-4217-b5c1-399ada497e3e\") "
Sep 08 00:39:31.353664 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.353636    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93caf825-c41d-4217-b5c1-399ada497e3e-config-file" (OuterVolumeSpecName: "config-file") pod "93caf825-c41d-4217-b5c1-399ada497e3e" (UID: "93caf825-c41d-4217-b5c1-399ada497e3e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:39:31.356630 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.356607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93caf825-c41d-4217-b5c1-399ada497e3e-kube-api-access-c4x2n" (OuterVolumeSpecName: "kube-api-access-c4x2n") pod "93caf825-c41d-4217-b5c1-399ada497e3e" (UID: "93caf825-c41d-4217-b5c1-399ada497e3e"). InnerVolumeSpecName "kube-api-access-c4x2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:39:31.454993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.454935    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4x2n\" (UniqueName: \"kubernetes.io/projected/93caf825-c41d-4217-b5c1-399ada497e3e-kube-api-access-c4x2n\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:39:31.454993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.454956    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93caf825-c41d-4217-b5c1-399ada497e3e-config-file\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:39:31.974814 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.974769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" event={"ID":"edcd4584-56dc-4162-9f47-36784db854cc","Type":"ContainerStarted","Data":"52cf66d87ae006c70ab6d2a88a4a26b6aef238ecdf96b459e9c5ada410d0314f"}
Sep 08 00:39:31.977550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.977512    2578 generic.go:356] "Generic (PLEG): container finished" podID="93caf825-c41d-4217-b5c1-399ada497e3e" containerID="9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839" exitCode=0
Sep 08 00:39:31.978218 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.978192    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s"
Sep 08 00:39:31.980952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.980926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s" event={"ID":"93caf825-c41d-4217-b5c1-399ada497e3e","Type":"ContainerDied","Data":"9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839"}
Sep 08 00:39:31.981150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.981130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fst5s" event={"ID":"93caf825-c41d-4217-b5c1-399ada497e3e","Type":"ContainerDied","Data":"3042a447d637d33474348bacdc7f14e70a194aef5380f330f2cedbf79c265388"}
Sep 08 00:39:31.981276 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:31.981263    2578 scope.go:117] "RemoveContainer" containerID="9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839"
Sep 08 00:39:32.004946 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.004900    2578 scope.go:117] "RemoveContainer" containerID="9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839"
Sep 08 00:39:32.005380 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:39:32.005351    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839\": container with ID starting with 9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839 not found: ID does not exist" containerID="9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839"
Sep 08 00:39:32.005484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.005392    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839"} err="failed to get container status \"9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839\": rpc error: code = NotFound desc = could not find container \"9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839\": container with ID starting with 9d26e2fbc913d99165c214ee40babedb5e7ff126ae985c25de63a94243c32839 not found: ID does not exist"
Sep 08 00:39:32.017945 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.017912    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:32.021074 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.021052    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fst5s"]
Sep 08 00:39:32.057195 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.057167    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93caf825-c41d-4217-b5c1-399ada497e3e" path="/var/lib/kubelet/pods/93caf825-c41d-4217-b5c1-399ada497e3e/volumes"
Sep 08 00:39:32.964533 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.964504    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:39:32.965780 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.965749    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rwdt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 08 00:39:32.965911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:32.965812    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" podUID="edcd4584-56dc-4162-9f47-36784db854cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 08 00:39:33.964594 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:33.964542    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rwdt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 08 00:39:33.965070 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:33.964742    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" podUID="edcd4584-56dc-4162-9f47-36784db854cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 08 00:39:34.965171 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:34.965132    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rwdt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 08 00:39:34.965547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:34.965199    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" podUID="edcd4584-56dc-4162-9f47-36784db854cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 08 00:39:35.933795 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:35.933767    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-np5lm"
Sep 08 00:39:35.964699 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:35.964654    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rwdt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 08 00:39:35.964875 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:35.964738    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" podUID="edcd4584-56dc-4162-9f47-36784db854cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 08 00:39:36.659963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.659926    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cb57d9f96-chkgz"]
Sep 08 00:39:36.660467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.660450    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93caf825-c41d-4217-b5c1-399ada497e3e" containerName="limitador"
Sep 08 00:39:36.660521 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.660468    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93caf825-c41d-4217-b5c1-399ada497e3e" containerName="limitador"
Sep 08 00:39:36.660612 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.660600    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="93caf825-c41d-4217-b5c1-399ada497e3e" containerName="limitador"
Sep 08 00:39:36.666033 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.666012    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.680663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.680641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb57d9f96-chkgz"]
Sep 08 00:39:36.710879 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.710855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7bb8\" (UniqueName: \"kubernetes.io/projected/181f802f-92eb-4070-82e2-520ef12a4648-kube-api-access-m7bb8\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.711038 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.710916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-oauth-serving-cert\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.711038 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.710984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/181f802f-92eb-4070-82e2-520ef12a4648-console-oauth-config\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.711038 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.711030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/181f802f-92eb-4070-82e2-520ef12a4648-console-serving-cert\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.711221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.711061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-console-config\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.711221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.711119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-service-ca\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.711221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.711167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-trusted-ca-bundle\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.725922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.725887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:36.790180 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.790151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:36.812367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-service-ca\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.812474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-trusted-ca-bundle\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.812474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7bb8\" (UniqueName: \"kubernetes.io/projected/181f802f-92eb-4070-82e2-520ef12a4648-kube-api-access-m7bb8\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.812474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-oauth-serving-cert\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.812474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/181f802f-92eb-4070-82e2-520ef12a4648-console-oauth-config\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.812703 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/181f802f-92eb-4070-82e2-520ef12a4648-console-serving-cert\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.812703 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.812515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-console-config\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.813224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.813198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-service-ca\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.813224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.813217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-oauth-serving-cert\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.813363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.813256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-console-config\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.813363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.813309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/181f802f-92eb-4070-82e2-520ef12a4648-trusted-ca-bundle\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.815172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.815148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/181f802f-92eb-4070-82e2-520ef12a4648-console-oauth-config\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.815252 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.815148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/181f802f-92eb-4070-82e2-520ef12a4648-console-serving-cert\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.820918 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.820896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7bb8\" (UniqueName: \"kubernetes.io/projected/181f802f-92eb-4070-82e2-520ef12a4648-kube-api-access-m7bb8\") pod \"console-cb57d9f96-chkgz\" (UID: \"181f802f-92eb-4070-82e2-520ef12a4648\") " pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.964981 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.964908    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rwdt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 08 00:39:36.964981 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.964965    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9" podUID="edcd4584-56dc-4162-9f47-36784db854cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 08 00:39:36.977723 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.977695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:36.998574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:36.997881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 00:39:37.048698 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.048510    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"]
Sep 08 00:39:37.048826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.048759    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg" podUID="f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" containerName="maas-api" containerID="cri-o://7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb" gracePeriod=30
Sep 08 00:39:37.267110 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.267086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb57d9f96-chkgz"]
Sep 08 00:39:37.269499 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:39:37.269475    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181f802f_92eb_4070_82e2_520ef12a4648.slice/crio-2b394f523989210a37cf39a695925f4b953fcd3384c87a0c7b7af0574097cd8e WatchSource:0}: Error finding container 2b394f523989210a37cf39a695925f4b953fcd3384c87a0c7b7af0574097cd8e: Status 404 returned error can't find the container with id 2b394f523989210a37cf39a695925f4b953fcd3384c87a0c7b7af0574097cd8e
Sep 08 00:39:37.288258 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.288232    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:37.317577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.316284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqctf\" (UniqueName: \"kubernetes.io/projected/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-kube-api-access-dqctf\") pod \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") "
Sep 08 00:39:37.317577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.316337    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-maas-api-tls\") pod \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") "
Sep 08 00:39:37.317577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.316409    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-metrics-certs\") pod \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") "
Sep 08 00:39:37.317577 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.316495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-openshift-service-ca\") pod \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\" (UID: \"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2\") "
Sep 08 00:39:37.319289 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.319184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" (UID: "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:39:37.320165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.320136    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" (UID: "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:39:37.321497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.321467    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-kube-api-access-dqctf" (OuterVolumeSpecName: "kube-api-access-dqctf") pod "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" (UID: "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2"). InnerVolumeSpecName "kube-api-access-dqctf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:39:37.321657 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.321637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" (UID: "f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:39:37.419789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.419756    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-openshift-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:39:37.419789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.419786    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqctf\" (UniqueName: \"kubernetes.io/projected/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-kube-api-access-dqctf\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:39:37.419992 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.419798    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-maas-api-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:39:37.419992 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.419812    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2-metrics-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:39:37.950514 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.950488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-7d6487fcc8-xqsrp"
Sep 08 00:39:37.969449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.969417    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:39:37.969803 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.969787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:39:37.970569 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:37.970553    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rwdt9"
Sep 08 00:39:38.022817 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.022789    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" containerID="7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb" exitCode=0
Sep 08 00:39:38.022975 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.022826    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"
Sep 08 00:39:38.022975 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.022865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg" event={"ID":"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2","Type":"ContainerDied","Data":"7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb"}
Sep 08 00:39:38.023181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.023146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg" event={"ID":"f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2","Type":"ContainerDied","Data":"e1eb3dff69164003a77184f9c70aa7bd8265c2cdd0fe01bbd708f98dc4dc5bf1"}
Sep 08 00:39:38.023181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.023170    2578 scope.go:117] "RemoveContainer" containerID="7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb"
Sep 08 00:39:38.026822 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.026756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb57d9f96-chkgz" event={"ID":"181f802f-92eb-4070-82e2-520ef12a4648","Type":"ContainerStarted","Data":"91cdfbc792913c2562d5ee21f8138aefd6ca6b56cf4fbcc8ea3ae7d67ad10ba9"}
Sep 08 00:39:38.026822 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.026793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb57d9f96-chkgz" event={"ID":"181f802f-92eb-4070-82e2-520ef12a4648","Type":"ContainerStarted","Data":"2b394f523989210a37cf39a695925f4b953fcd3384c87a0c7b7af0574097cd8e"}
Sep 08 00:39:38.036473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.036432    2578 scope.go:117] "RemoveContainer" containerID="7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb"
Sep 08 00:39:38.036845 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:39:38.036777    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb\": container with ID starting with 7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb not found: ID does not exist" containerID="7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb"
Sep 08 00:39:38.036845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.036810    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb"} err="failed to get container status \"7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb\": rpc error: code = NotFound desc = could not find container \"7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb\": container with ID starting with 7856121de41d310a7d75a67e61f0a13273d929b5ba60b5d60289a3eb3e879ecb not found: ID does not exist"
Sep 08 00:39:38.057454 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.057399    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cb57d9f96-chkgz" podStartSLOduration=2.057381444 podStartE2EDuration="2.057381444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:38.056532189 +0000 UTC m=+400.434905624" watchObservedRunningTime="2026-09-08 00:39:38.057381444 +0000 UTC m=+400.435754878"
Sep 08 00:39:38.079081 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.079008    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"]
Sep 08 00:39:38.082762 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:38.082740    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-768897d8b6-4cnzg"]
Sep 08 00:39:40.057931 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:40.057895    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" path="/var/lib/kubelet/pods/f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2/volumes"
Sep 08 00:39:46.978191 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:46.978145    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:46.978749 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:46.978220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:46.983648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:46.983621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:47.084267 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:47.084244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cb57d9f96-chkgz"
Sep 08 00:39:47.132623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:47.132557    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694799c854-6g8n2"]
Sep 08 00:39:47.236883 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:47.236796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:47.297661 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:47.297623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:47.362793 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:47.362765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:39:58.955560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:39:58.955530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-jh7pn"
Sep 08 00:40:12.161504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.161439    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-694799c854-6g8n2" podUID="8f19d1a7-5a76-4391-bc50-9be290e96ace" containerName="console" containerID="cri-o://37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242" gracePeriod=15
Sep 08 00:40:12.398138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.398115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:40:12.505901 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.505840    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-config\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.505901 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.505877    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7psrf\" (UniqueName: \"kubernetes.io/projected/8f19d1a7-5a76-4391-bc50-9be290e96ace-kube-api-access-7psrf\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.506097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.505906    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-service-ca\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.506097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.505929    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-oauth-serving-cert\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.506097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.505958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-trusted-ca-bundle\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.506260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-serving-cert\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.506326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506260    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-config" (OuterVolumeSpecName: "console-config") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:40:12.506326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506318    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-oauth-config\") pod \"8f19d1a7-5a76-4391-bc50-9be290e96ace\" (UID: \"8f19d1a7-5a76-4391-bc50-9be290e96ace\") "
Sep 08 00:40:12.506473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506355    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:40:12.506473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506365    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:40:12.506473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506387    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:40:12.506624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506609    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:12.506671 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506627    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:12.506671 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506644    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-oauth-serving-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:12.506671 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.506661    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f19d1a7-5a76-4391-bc50-9be290e96ace-trusted-ca-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:12.508189 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.508163    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:40:12.508306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.508284    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:40:12.508353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.508294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f19d1a7-5a76-4391-bc50-9be290e96ace-kube-api-access-7psrf" (OuterVolumeSpecName: "kube-api-access-7psrf") pod "8f19d1a7-5a76-4391-bc50-9be290e96ace" (UID: "8f19d1a7-5a76-4391-bc50-9be290e96ace"). InnerVolumeSpecName "kube-api-access-7psrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:40:12.607866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.607839    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-serving-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:12.607866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.607863    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f19d1a7-5a76-4391-bc50-9be290e96ace-console-oauth-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:12.608011 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:12.607877    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7psrf\" (UniqueName: \"kubernetes.io/projected/8f19d1a7-5a76-4391-bc50-9be290e96ace-kube-api-access-7psrf\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:40:13.222162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.222124    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f19d1a7-5a76-4391-bc50-9be290e96ace" containerID="37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242" exitCode=0
Sep 08 00:40:13.222622 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.222173    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694799c854-6g8n2"
Sep 08 00:40:13.222622 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.222184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694799c854-6g8n2" event={"ID":"8f19d1a7-5a76-4391-bc50-9be290e96ace","Type":"ContainerDied","Data":"37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242"}
Sep 08 00:40:13.222622 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.222233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694799c854-6g8n2" event={"ID":"8f19d1a7-5a76-4391-bc50-9be290e96ace","Type":"ContainerDied","Data":"9ff5dbc2461dd814ee849d610ea9a62ccfc554b132155396a80ffcb170080e32"}
Sep 08 00:40:13.222622 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.222260    2578 scope.go:117] "RemoveContainer" containerID="37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242"
Sep 08 00:40:13.235492 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.235471    2578 scope.go:117] "RemoveContainer" containerID="37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242"
Sep 08 00:40:13.235809 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:40:13.235783    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242\": container with ID starting with 37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242 not found: ID does not exist" containerID="37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242"
Sep 08 00:40:13.235867 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.235820    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242"} err="failed to get container status \"37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242\": rpc error: code = NotFound desc = could not find container \"37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242\": container with ID starting with 37b9458e5e9804bd6dac2722c70f50eb2ec94f6ae7e4173e45130627daa5d242 not found: ID does not exist"
Sep 08 00:40:13.246434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.246408    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694799c854-6g8n2"]
Sep 08 00:40:13.249909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:13.249888    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-694799c854-6g8n2"]
Sep 08 00:40:14.057497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:14.057464    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f19d1a7-5a76-4391-bc50-9be290e96ace" path="/var/lib/kubelet/pods/8f19d1a7-5a76-4391-bc50-9be290e96ace/volumes"
Sep 08 00:40:32.521219 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:32.521122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:32.618195 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:32.618161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:43.843658 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.843622    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"]
Sep 08 00:40:43.844147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.843983    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" containerName="maas-api"
Sep 08 00:40:43.844147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.843994    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" containerName="maas-api"
Sep 08 00:40:43.844147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.844004    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f19d1a7-5a76-4391-bc50-9be290e96ace" containerName="console"
Sep 08 00:40:43.844147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.844010    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f19d1a7-5a76-4391-bc50-9be290e96ace" containerName="console"
Sep 08 00:40:43.844147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.844082    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e686ba-5bc1-4d52-9e1b-94c0ad62d0e2" containerName="maas-api"
Sep 08 00:40:43.844147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.844090    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f19d1a7-5a76-4391-bc50-9be290e96ace" containerName="console"
Sep 08 00:40:43.848305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.848284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:43.850639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.850620    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 00:40:43.850769 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.850663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 00:40:43.851673 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.851658    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 00:40:43.851764 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.851733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cnbvb\""
Sep 08 00:40:43.858169 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.858142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"]
Sep 08 00:40:43.930480 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.930416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:43.958050 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.958025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:43.958163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.958068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:43.958163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.958111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:43.958163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.958159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02feb397-35dc-43f3-8607-9c033d2efe5d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:43.958285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.958204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:43.958285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:43.958243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7gm\" (UniqueName: \"kubernetes.io/projected/02feb397-35dc-43f3-8607-9c033d2efe5d-kube-api-access-cr7gm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.059667 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.059631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02feb397-35dc-43f3-8607-9c033d2efe5d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.059863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.059712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.059863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.059764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7gm\" (UniqueName: \"kubernetes.io/projected/02feb397-35dc-43f3-8607-9c033d2efe5d-kube-api-access-cr7gm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.059863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.059789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.059863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.059825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.060086 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.059999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.060336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.060314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.060428 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.060386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.060428 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.060404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.061954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.061929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02feb397-35dc-43f3-8607-9c033d2efe5d-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.062251 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.062234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02feb397-35dc-43f3-8607-9c033d2efe5d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.067842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.067816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7gm\" (UniqueName: \"kubernetes.io/projected/02feb397-35dc-43f3-8607-9c033d2efe5d-kube-api-access-cr7gm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr\" (UID: \"02feb397-35dc-43f3-8607-9c033d2efe5d\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.158960 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.158887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:44.433147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:44.431247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"]
Sep 08 00:40:44.434934 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:40:44.434909    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02feb397_35dc_43f3_8607_9c033d2efe5d.slice/crio-ee5af74f3980e04e20498590d27d377016761f9b3bd7d107f8961e665eb6abb3 WatchSource:0}: Error finding container ee5af74f3980e04e20498590d27d377016761f9b3bd7d107f8961e665eb6abb3: Status 404 returned error can't find the container with id ee5af74f3980e04e20498590d27d377016761f9b3bd7d107f8961e665eb6abb3
Sep 08 00:40:45.392605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:45.392560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr" event={"ID":"02feb397-35dc-43f3-8607-9c033d2efe5d","Type":"ContainerStarted","Data":"ee5af74f3980e04e20498590d27d377016761f9b3bd7d107f8961e665eb6abb3"}
Sep 08 00:40:46.399763 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:46.399723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr" event={"ID":"02feb397-35dc-43f3-8607-9c033d2efe5d","Type":"ContainerStarted","Data":"4f78dbae1e323a1184615174b7a48acda4500b5bb3f9b02d33c4279a9aa20aac"}
Sep 08 00:40:46.424188 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:46.424139    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr" podStartSLOduration=2.241246419 podStartE2EDuration="3.424122418s" totalImagesPullingTime="1.182875999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:40:46.422790994 +0000 UTC m=+468.801164428" watchObservedRunningTime="2026-09-08 00:40:46.424122418 +0000 UTC m=+468.802495854"
Sep 08 00:40:47.159558 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:47.159525    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:51.317389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.317353    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"]
Sep 08 00:40:51.321606 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.321581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.324540 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.324509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 00:40:51.327591 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.327567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"]
Sep 08 00:40:51.347265 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.347231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:40:51.422625 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.422598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.422842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.422669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.422842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.422784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.422972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.422861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.422972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.422893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmtd\" (UniqueName: \"kubernetes.io/projected/56d175c7-acd6-4615-b7fb-03ee8df625b2-kube-api-access-cjmtd\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.422972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.422921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d175c7-acd6-4615-b7fb-03ee8df625b2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.523819 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.523790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.523949 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.523823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmtd\" (UniqueName: \"kubernetes.io/projected/56d175c7-acd6-4615-b7fb-03ee8df625b2-kube-api-access-cjmtd\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.523949 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.523840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d175c7-acd6-4615-b7fb-03ee8df625b2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.523949 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.523910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.524134 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.523963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.524134 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.524021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.524335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.524311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.524335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.524329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.524462 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.524443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.526152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.526130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d175c7-acd6-4615-b7fb-03ee8df625b2-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.526383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.526364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d175c7-acd6-4615-b7fb-03ee8df625b2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.531580 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.531559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmtd\" (UniqueName: \"kubernetes.io/projected/56d175c7-acd6-4615-b7fb-03ee8df625b2-kube-api-access-cjmtd\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-bd8pf\" (UID: \"56d175c7-acd6-4615-b7fb-03ee8df625b2\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.633928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.633874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:51.905774 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:51.905584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"]
Sep 08 00:40:51.908196 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:40:51.908172    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d175c7_acd6_4615_b7fb_03ee8df625b2.slice/crio-dbef43aa4c001226e8f7693048a1eb22ed19b292bceb699364954139331a1a44 WatchSource:0}: Error finding container dbef43aa4c001226e8f7693048a1eb22ed19b292bceb699364954139331a1a44: Status 404 returned error can't find the container with id dbef43aa4c001226e8f7693048a1eb22ed19b292bceb699364954139331a1a44
Sep 08 00:40:52.433490 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:52.433453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf" event={"ID":"56d175c7-acd6-4615-b7fb-03ee8df625b2","Type":"ContainerStarted","Data":"aa14c65c85dfc832ef072dfd450daa58e5b6d4071265cd2df0fd278e6c4225e3"}
Sep 08 00:40:52.433867 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:52.433505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf" event={"ID":"56d175c7-acd6-4615-b7fb-03ee8df625b2","Type":"ContainerStarted","Data":"dbef43aa4c001226e8f7693048a1eb22ed19b292bceb699364954139331a1a44"}
Sep 08 00:40:52.452988 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:52.452941    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf" podStartSLOduration=1.268585604 podStartE2EDuration="1.452925628s" totalImagesPullingTime="184.340024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:40:52.450596011 +0000 UTC m=+474.828969453" watchObservedRunningTime="2026-09-08 00:40:52.452925628 +0000 UTC m=+474.831299118"
Sep 08 00:40:52.634729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:52.634695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:40:54.159729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:54.159698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:54.172138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:54.172114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:40:54.454247 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:40:54.454177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr"
Sep 08 00:41:01.634958 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:01.634923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:41:01.647076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:01.647056    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:41:02.221235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.221204    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"]
Sep 08 00:41:02.226108 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.226089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.228718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.228670    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 00:41:02.238841 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.238820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"]
Sep 08 00:41:02.268092 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.268060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:41:02.319842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.319812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr5qk\" (UniqueName: \"kubernetes.io/projected/625a1d19-6b03-4e7c-9347-c3cf244605c2-kube-api-access-qr5qk\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.319954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.319864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.319954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.319917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.320055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.319985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.320055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.320016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.320055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.320040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625a1d19-6b03-4e7c-9347-c3cf244605c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr5qk\" (UniqueName: \"kubernetes.io/projected/625a1d19-6b03-4e7c-9347-c3cf244605c2-kube-api-access-qr5qk\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421525 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421525 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625a1d19-6b03-4e7c-9347-c3cf244605c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421756 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421813 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.421855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.421829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.423727 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.423700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625a1d19-6b03-4e7c-9347-c3cf244605c2-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.423897 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.423878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625a1d19-6b03-4e7c-9347-c3cf244605c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.429976 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.429956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr5qk\" (UniqueName: \"kubernetes.io/projected/625a1d19-6b03-4e7c-9347-c3cf244605c2-kube-api-access-qr5qk\") pod \"e2e-embedding-simulated-kserve-698db7d589-hx7d7\" (UID: \"625a1d19-6b03-4e7c-9347-c3cf244605c2\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.497187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.497109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-bd8pf"
Sep 08 00:41:02.536861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.536837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:02.816940 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:02.816913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"]
Sep 08 00:41:02.818337 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:41:02.818312    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625a1d19_6b03_4e7c_9347_c3cf244605c2.slice/crio-4a6f4fa4b2ba68b4fc25fbec6659f6de562bf5056f68534b23b5a79be647a2f7 WatchSource:0}: Error finding container 4a6f4fa4b2ba68b4fc25fbec6659f6de562bf5056f68534b23b5a79be647a2f7: Status 404 returned error can't find the container with id 4a6f4fa4b2ba68b4fc25fbec6659f6de562bf5056f68534b23b5a79be647a2f7
Sep 08 00:41:03.491716 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:03.491661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7" event={"ID":"625a1d19-6b03-4e7c-9347-c3cf244605c2","Type":"ContainerStarted","Data":"cd72413806f05668545371dfe5602a1b25a12e8f72eb634e6bcb55e540d39c2c"}
Sep 08 00:41:03.492190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:03.491730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7" event={"ID":"625a1d19-6b03-4e7c-9347-c3cf244605c2","Type":"ContainerStarted","Data":"4a6f4fa4b2ba68b4fc25fbec6659f6de562bf5056f68534b23b5a79be647a2f7"}
Sep 08 00:41:03.510482 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:03.510427    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7" podStartSLOduration=1.329633128 podStartE2EDuration="1.510406568s" totalImagesPullingTime="180.77344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:41:03.50839123 +0000 UTC m=+485.886764665" watchObservedRunningTime="2026-09-08 00:41:03.510406568 +0000 UTC m=+485.888780002"
Sep 08 00:41:03.537181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:03.537157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:10.128552 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.128521    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"]
Sep 08 00:41:10.139114 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.139088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.141836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.141815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 00:41:10.142250 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.142227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"]
Sep 08 00:41:10.161722 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.161697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:41:10.286339 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.286313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6778\" (UniqueName: \"kubernetes.io/projected/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-kube-api-access-b6778\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.286452 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.286353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.286452 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.286370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.286531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.286461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.286531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.286511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.286597 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.286530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388008 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.387932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388008 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.387996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6778\" (UniqueName: \"kubernetes.io/projected/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-kube-api-access-b6778\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388407 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.388642 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.388617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.390390 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.390366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.390570 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.390555    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.396995 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.396976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6778\" (UniqueName: \"kubernetes.io/projected/23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b-kube-api-access-b6778\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l\" (UID: \"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.453918 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.453895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:10.727869 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:10.727842    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"]
Sep 08 00:41:10.729663 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:41:10.729634    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a2cdda_1a6b_4cb1_a67b_c3e2b2d2219b.slice/crio-bb818e28ed39348774ebfb6dfa05c017c9d36ad6b5a7fa54cf15885d2ee498c1 WatchSource:0}: Error finding container bb818e28ed39348774ebfb6dfa05c017c9d36ad6b5a7fa54cf15885d2ee498c1: Status 404 returned error can't find the container with id bb818e28ed39348774ebfb6dfa05c017c9d36ad6b5a7fa54cf15885d2ee498c1
Sep 08 00:41:11.538547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:11.538515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l" event={"ID":"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b","Type":"ContainerStarted","Data":"b5a18797f1e3deec07b5e05be6c9364cb80d4e9ec1279d3ad60a38d3d102f806"}
Sep 08 00:41:11.539012 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:11.538568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l" event={"ID":"23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b","Type":"ContainerStarted","Data":"bb818e28ed39348774ebfb6dfa05c017c9d36ad6b5a7fa54cf15885d2ee498c1"}
Sep 08 00:41:11.557724 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:11.557651    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l" podStartSLOduration=1.376667524 podStartE2EDuration="1.557632743s" totalImagesPullingTime="180.965219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:41:11.55724271 +0000 UTC m=+493.935616156" watchObservedRunningTime="2026-09-08 00:41:11.557632743 +0000 UTC m=+493.936006176"
Sep 08 00:41:12.454416 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:12.454379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:12.537330 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:12.537296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:12.549717 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:12.549678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:12.561333 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:12.561312    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-hx7d7"
Sep 08 00:41:16.971019 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:16.970986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:41:20.454267 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:20.454222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:20.466304 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:20.466269    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:20.603424 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:20.603395    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l"
Sep 08 00:41:33.355547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:33.355506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:41:45.863337 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:41:45.863301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:03.909182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:03.909141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:04.005355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:04.005318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:04.947974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:04.947940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:05.043307 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:05.043271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:20.519472 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.519432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:20.621804 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.621677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:20.797453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.797424    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"]
Sep 08 00:43:20.801114 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.801092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.803513 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.803492    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1cf84f-openshift-default-dockercfg-q2c8g\""
Sep 08 00:43:20.813980 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.813959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"]
Sep 08 00:43:20.830019 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.829991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:20.943522 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-data\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943716 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-envoy\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943716 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-certs\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943716 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qvx8\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-kube-api-access-7qvx8\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943837 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d611488d-7e41-4642-90c9-b8bedf9ed262-istiod-ca-cert\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943837 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-socket\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943901 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-token\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943945 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-credential-socket\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:20.943983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:20.943969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-podinfo\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044528 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-token\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-credential-socket\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-podinfo\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-data\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-envoy\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-certs\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.044908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qvx8\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-kube-api-access-7qvx8\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045122 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.045094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-certs\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.044952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-credential-socket\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.045112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d611488d-7e41-4642-90c9-b8bedf9ed262-istiod-ca-cert\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.045013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-data\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045260 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.045184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-socket\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045457 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.045440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-socket\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.045786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.045763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d611488d-7e41-4642-90c9-b8bedf9ed262-istiod-ca-cert\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.047082 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.047060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-podinfo\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.047202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.047184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-envoy\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.053160 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.053109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-token\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.053605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.053583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qvx8\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-kube-api-access-7qvx8\") pod \"e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") " pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.101034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.101006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:21.115982 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.115951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:21.403538 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.403508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"]
Sep 08 00:43:21.404942 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:43:21.404910    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd611488d_7e41_4642_90c9_b8bedf9ed262.slice/crio-d4ddd8c8a9db5fbec0ffbe306dbae6af1600c03b5afbb194c780e9f57761d7ae WatchSource:0}: Error finding container d4ddd8c8a9db5fbec0ffbe306dbae6af1600c03b5afbb194c780e9f57761d7ae: Status 404 returned error can't find the container with id d4ddd8c8a9db5fbec0ffbe306dbae6af1600c03b5afbb194c780e9f57761d7ae
Sep 08 00:43:21.407123 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.407083    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:21.407195 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.407181    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:21.407238 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.407226    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:21.799456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.799425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:21.897936 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.897901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:21.962675 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:21.962648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:22.261317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:22.261230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" event={"ID":"d611488d-7e41-4642-90c9-b8bedf9ed262","Type":"ContainerStarted","Data":"16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"}
Sep 08 00:43:22.261317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:22.261287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" event={"ID":"d611488d-7e41-4642-90c9-b8bedf9ed262","Type":"ContainerStarted","Data":"d4ddd8c8a9db5fbec0ffbe306dbae6af1600c03b5afbb194c780e9f57761d7ae"}
Sep 08 00:43:22.268172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:22.268145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:22.285233 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:22.285185    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podStartSLOduration=2.285169867 podStartE2EDuration="2.285169867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:43:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:43:22.282920718 +0000 UTC m=+624.661294165" watchObservedRunningTime="2026-09-08 00:43:22.285169867 +0000 UTC m=+624.663543298"
Sep 08 00:43:23.116894 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:23.116852    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:23.122163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:23.122132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:23.267570 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:23.267538    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:23.268420 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:23.268398    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:24.161222 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:24.161184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:24.250803 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:24.250765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:25.438924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.438886    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"]
Sep 08 00:43:25.443542 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.443521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.448380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.448323    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-1cf84f-serving-cert\""
Sep 08 00:43:25.451411 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.449143    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"]
Sep 08 00:43:25.465725 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.465675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:25.528286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.528251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:25.587002 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.586971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-metrics-certs\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.587137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.587050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5972f7ed-a128-4ac3-b193-29c5edbcc932-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.587137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.587121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.587137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.587137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpvgd\" (UniqueName: \"kubernetes.io/projected/5972f7ed-a128-4ac3-b193-29c5edbcc932-kube-api-access-rpvgd\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.688225 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.688195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5972f7ed-a128-4ac3-b193-29c5edbcc932-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.688400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.688266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.688400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.688295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpvgd\" (UniqueName: \"kubernetes.io/projected/5972f7ed-a128-4ac3-b193-29c5edbcc932-kube-api-access-rpvgd\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.688513 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:43:25.688424    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-serving-cert: secret "maas-api-e2e-inf-a-1cf84f-serving-cert" not found
Sep 08 00:43:25.688513 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.688432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-metrics-certs\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.688513 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:43:25.688483    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls podName:5972f7ed-a128-4ac3-b193-29c5edbcc932 nodeName:}" failed. No retries permitted until 2026-09-08 00:43:26.188466298 +0000 UTC m=+628.566839709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls") pod "maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" (UID: "5972f7ed-a128-4ac3-b193-29c5edbcc932") : secret "maas-api-e2e-inf-a-1cf84f-serving-cert" not found
Sep 08 00:43:25.688909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.688891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5972f7ed-a128-4ac3-b193-29c5edbcc932-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.691107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.691044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-metrics-certs\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.699218 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.699190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpvgd\" (UniqueName: \"kubernetes.io/projected/5972f7ed-a128-4ac3-b193-29c5edbcc932-kube-api-access-rpvgd\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:25.780298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:25.780268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:26.044839 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.039864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:26.130063 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.130026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:26.131662 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.131642    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"]
Sep 08 00:43:26.135115 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.135099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.137462 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.137443    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1cf84f\""
Sep 08 00:43:26.150505 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.150481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"]
Sep 08 00:43:26.194449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.194421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:26.196919 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.196895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls\") pod \"maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:26.296185 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.296100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhm2q\" (UniqueName: \"kubernetes.io/projected/5354b04d-9305-4d18-a1bc-88d3bf21f056-kube-api-access-dhm2q\") pod \"payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.296185 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.296153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5354b04d-9305-4d18-a1bc-88d3bf21f056-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.366550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.366510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:26.397908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.397874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhm2q\" (UniqueName: \"kubernetes.io/projected/5354b04d-9305-4d18-a1bc-88d3bf21f056-kube-api-access-dhm2q\") pod \"payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.398022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.397928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5354b04d-9305-4d18-a1bc-88d3bf21f056-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.399011 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.398982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5354b04d-9305-4d18-a1bc-88d3bf21f056-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.406120 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.406058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhm2q\" (UniqueName: \"kubernetes.io/projected/5354b04d-9305-4d18-a1bc-88d3bf21f056-kube-api-access-dhm2q\") pod \"payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.445885 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.445860    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:26.640757 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.640734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"]
Sep 08 00:43:26.642216 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:43:26.642181    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5972f7ed_a128_4ac3_b193_29c5edbcc932.slice/crio-4b5e197c9983e87c77e40e5de4f573d7adc4eadd3645463d2a7b1e358400f11f WatchSource:0}: Error finding container 4b5e197c9983e87c77e40e5de4f573d7adc4eadd3645463d2a7b1e358400f11f: Status 404 returned error can't find the container with id 4b5e197c9983e87c77e40e5de4f573d7adc4eadd3645463d2a7b1e358400f11f
Sep 08 00:43:26.643600 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.643583    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:43:26.721001 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:26.720978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"]
Sep 08 00:43:26.721788 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:43:26.721768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5354b04d_9305_4d18_a1bc_88d3bf21f056.slice/crio-4bac0fee5a761efba60ea07753252744b85034bf67de4749843af1dfef3711f5 WatchSource:0}: Error finding container 4bac0fee5a761efba60ea07753252744b85034bf67de4749843af1dfef3711f5: Status 404 returned error can't find the container with id 4bac0fee5a761efba60ea07753252744b85034bf67de4749843af1dfef3711f5
Sep 08 00:43:27.295545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.295509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" event={"ID":"5972f7ed-a128-4ac3-b193-29c5edbcc932","Type":"ContainerStarted","Data":"fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5"}
Sep 08 00:43:27.295719 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.295558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" event={"ID":"5972f7ed-a128-4ac3-b193-29c5edbcc932","Type":"ContainerStarted","Data":"4b5e197c9983e87c77e40e5de4f573d7adc4eadd3645463d2a7b1e358400f11f"}
Sep 08 00:43:27.295719 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.295695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:27.297162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.297126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm" event={"ID":"5354b04d-9305-4d18-a1bc-88d3bf21f056","Type":"ContainerStarted","Data":"b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858"}
Sep 08 00:43:27.297284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.297192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm" event={"ID":"5354b04d-9305-4d18-a1bc-88d3bf21f056","Type":"ContainerStarted","Data":"4bac0fee5a761efba60ea07753252744b85034bf67de4749843af1dfef3711f5"}
Sep 08 00:43:27.297284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.297237    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:27.312150 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.312100    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" podStartSLOduration=1.789955709 podStartE2EDuration="2.312086861s" totalImagesPullingTime="522.131152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:43:27.310479616 +0000 UTC m=+629.688853054" watchObservedRunningTime="2026-09-08 00:43:27.312086861 +0000 UTC m=+629.690460293"
Sep 08 00:43:27.327773 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:27.327733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm" podStartSLOduration=1.327720053 podStartE2EDuration="1.327720053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:43:27.325292594 +0000 UTC m=+629.703666022" watchObservedRunningTime="2026-09-08 00:43:27.327720053 +0000 UTC m=+629.706093486"
Sep 08 00:43:28.257735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:28.257700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:29.494621 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.494586    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:29.520263 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.520235    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"]
Sep 08 00:43:29.524639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.524618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.527087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.527066    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-31f424-openshift-default-dockercfg-c7589\""
Sep 08 00:43:29.536722 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.536695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"]
Sep 08 00:43:29.585708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.585649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:29.626941 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.626904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-certs\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627092 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.626968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-envoy\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627092 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-podinfo\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istiod-ca-cert\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627209 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-token\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627312 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-socket\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627312 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2xhk\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-kube-api-access-r2xhk\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627413 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-data\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.627470 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.627411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-credential-socket\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728074 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istiod-ca-cert\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-token\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-socket\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2xhk\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-kube-api-access-r2xhk\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-data\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-credential-socket\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-certs\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-envoy\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-podinfo\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-socket\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-data\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728667    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-credential-socket\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728884 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istiod-ca-cert\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.728937 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.728883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-certs\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.730531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.730508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-envoy\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.730761 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.730745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-podinfo\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.736119 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.736095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2xhk\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-kube-api-access-r2xhk\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.736340 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.736321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-token\") pod \"e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") " pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.837373 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.837341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:29.849254 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:29.849225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:30.124526 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.124486    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"]
Sep 08 00:43:30.125778 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:43:30.125751    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bb5b63_a0ef_4f33_a35f_6a14cbd6deaa.slice/crio-c437d580ccf0f3440a1fa3508502c26b26648417cab2d20a149407d70f802154 WatchSource:0}: Error finding container c437d580ccf0f3440a1fa3508502c26b26648417cab2d20a149407d70f802154: Status 404 returned error can't find the container with id c437d580ccf0f3440a1fa3508502c26b26648417cab2d20a149407d70f802154
Sep 08 00:43:30.128186 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.128145    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:30.128263 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.128227    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:30.128303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.128269    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:30.315493 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.315459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" event={"ID":"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa","Type":"ContainerStarted","Data":"51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"}
Sep 08 00:43:30.315705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.315523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" event={"ID":"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa","Type":"ContainerStarted","Data":"c437d580ccf0f3440a1fa3508502c26b26648417cab2d20a149407d70f802154"}
Sep 08 00:43:30.336492 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.336444    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podStartSLOduration=1.336429607 podStartE2EDuration="1.336429607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:43:30.333247304 +0000 UTC m=+632.711620739" watchObservedRunningTime="2026-09-08 00:43:30.336429607 +0000 UTC m=+632.714803040"
Sep 08 00:43:30.837591 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.837554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:30.838521 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.838489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:30.932784 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:30.932745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:31.061623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:31.061584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:31.844179 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:31.844148    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:32.206439 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:32.206348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:32.298397 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:32.298362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:32.335811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:32.335778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:32.336586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:32.336567    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:33.309254 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.309219    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:43:33.345237 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.345209    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"]
Sep 08 00:43:33.349899 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.349878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.352544 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.352521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-31f424-serving-cert\""
Sep 08 00:43:33.360052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.360028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"]
Sep 08 00:43:33.380130 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.380102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a94a7c-1080-4175-ae94-fbff81934964-openshift-service-ca\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.381874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.381851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-metrics-certs\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.382352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.382334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-maas-api-tls\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.383347 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.383322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54z5\" (UniqueName: \"kubernetes.io/projected/08a94a7c-1080-4175-ae94-fbff81934964-kube-api-access-n54z5\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.397062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.397039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:33.488094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.485937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54z5\" (UniqueName: \"kubernetes.io/projected/08a94a7c-1080-4175-ae94-fbff81934964-kube-api-access-n54z5\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.488094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.486015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a94a7c-1080-4175-ae94-fbff81934964-openshift-service-ca\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.488094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.486081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-metrics-certs\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.488094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.486160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-maas-api-tls\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.488094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.487279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a94a7c-1080-4175-ae94-fbff81934964-openshift-service-ca\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.489631 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.489608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:33.492045 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.491985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-metrics-certs\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.496165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.496141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-maas-api-tls\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.508154 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.508107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54z5\" (UniqueName: \"kubernetes.io/projected/08a94a7c-1080-4175-ae94-fbff81934964-kube-api-access-n54z5\") pod \"maas-api-e2e-autores-31f424-7f6c674cc8-g77m8\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.584526 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.584438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:33.666996 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.666967    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:33.958795 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.958771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"]
Sep 08 00:43:33.961356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:33.961328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:33.961667 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:43:33.961633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a94a7c_1080_4175_ae94_fbff81934964.slice/crio-610bfdcced0b84b1807300f6e5c586ca636aaeb14147741ffa0196cff786048b WatchSource:0}: Error finding container 610bfdcced0b84b1807300f6e5c586ca636aaeb14147741ffa0196cff786048b: Status 404 returned error can't find the container with id 610bfdcced0b84b1807300f6e5c586ca636aaeb14147741ffa0196cff786048b
Sep 08 00:43:34.050461 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:34.050415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:34.349578 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:34.349540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8" event={"ID":"08a94a7c-1080-4175-ae94-fbff81934964","Type":"ContainerStarted","Data":"610bfdcced0b84b1807300f6e5c586ca636aaeb14147741ffa0196cff786048b"}
Sep 08 00:43:35.356941 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:35.356905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8" event={"ID":"08a94a7c-1080-4175-ae94-fbff81934964","Type":"ContainerStarted","Data":"84dd28cd2b939a8275a1ce047fd80fdf875a7899ab5f75a23b18c6f91123c6b8"}
Sep 08 00:43:35.357396 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:35.357035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:35.373185 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:35.373142    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8" podStartSLOduration=1.893268224 podStartE2EDuration="2.373128626s" totalImagesPullingTime="479.860402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:43:35.371548187 +0000 UTC m=+637.749921619" watchObservedRunningTime="2026-09-08 00:43:35.373128626 +0000 UTC m=+637.751502094"
Sep 08 00:43:36.841769 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:36.841739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:36.940670 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:36.940626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:37.407333 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:37.407296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:37.468496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:37.468464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:37.553540 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:37.553499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:37.727904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:37.727829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:38.218149 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.218116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:38.305095 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.305068    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:43:38.320881 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.320854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:38.422607 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.422576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:38.690182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.690149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:38.789493 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.789455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:38.808096 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.808065    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"]
Sep 08 00:43:38.811869 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.811852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:38.814751 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.814735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3b0b8262-dockercfg-4r2g4\""
Sep 08 00:43:38.815155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.815142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3b0b8262\""
Sep 08 00:43:38.830922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.827812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"]
Sep 08 00:43:38.866254 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.866219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbllz\" (UniqueName: \"kubernetes.io/projected/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-kube-api-access-sbllz\") pod \"payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:38.866425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.866334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:38.967643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.967558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbllz\" (UniqueName: \"kubernetes.io/projected/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-kube-api-access-sbllz\") pod \"payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:38.967643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.967622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:38.968311 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.968289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:38.977107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:38.977082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbllz\" (UniqueName: \"kubernetes.io/projected/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-kube-api-access-sbllz\") pod \"payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:39.123222 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.123191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:39.309749 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.308797    2578 patch_prober.go:28] interesting pod/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:43:39.309749 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.308864    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:43:39.380631 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.380597    2578 generic.go:356] "Generic (PLEG): container finished" podID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerID="16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6" exitCode=0
Sep 08 00:43:39.380762 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.380636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" event={"ID":"d611488d-7e41-4642-90c9-b8bedf9ed262","Type":"ContainerDied","Data":"16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"}
Sep 08 00:43:39.381145 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.381123    2578 scope.go:117] "RemoveContainer" containerID="16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"
Sep 08 00:43:39.382449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.382414    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:39.382544 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.382501    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:39.382589 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.382543    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:39.407677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:39.407654    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"]
Sep 08 00:43:39.408191 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:43:39.408168    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3aaaa5_d6b3_4cc5_8f20_8a37d50d7d10.slice/crio-7deeb80f0d1939dd1c709041d32415165bc0a6c5aafaf02594a47a8a7e82f553 WatchSource:0}: Error finding container 7deeb80f0d1939dd1c709041d32415165bc0a6c5aafaf02594a47a8a7e82f553: Status 404 returned error can't find the container with id 7deeb80f0d1939dd1c709041d32415165bc0a6c5aafaf02594a47a8a7e82f553
Sep 08 00:43:40.392235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:40.392184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh" event={"ID":"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10","Type":"ContainerStarted","Data":"cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a"}
Sep 08 00:43:40.392751 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:40.392262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:40.392751 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:40.392284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh" event={"ID":"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10","Type":"ContainerStarted","Data":"7deeb80f0d1939dd1c709041d32415165bc0a6c5aafaf02594a47a8a7e82f553"}
Sep 08 00:43:40.394514 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:40.394487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" event={"ID":"d611488d-7e41-4642-90c9-b8bedf9ed262","Type":"ContainerStarted","Data":"d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428"}
Sep 08 00:43:40.414062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:40.413999    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh" podStartSLOduration=2.4139802870000002 podStartE2EDuration="2.413980287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:43:40.412080075 +0000 UTC m=+642.790453535" watchObservedRunningTime="2026-09-08 00:43:40.413980287 +0000 UTC m=+642.792353723"
Sep 08 00:43:41.116911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:41.116873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:41.117078 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:41.117026    2578 patch_prober.go:28] interesting pod/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 00:43:41.117123 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:41.117076    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 00:43:41.367978 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:41.367905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:43:42.116657 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:42.116626    2578 patch_prober.go:28] interesting pod/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 00:43:42.117052 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:42.116676    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 00:43:43.117240 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:43.117201    2578 patch_prober.go:28] interesting pod/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 00:43:43.117627 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:43.117261    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 00:43:43.266835 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:43.266796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:43.367478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:43.367396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:44.116886 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:44.116852    2578 patch_prober.go:28] interesting pod/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 00:43:44.117054 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:44.116904    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 00:43:45.116672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:45.116642    2578 patch_prober.go:28] interesting pod/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 00:43:45.117157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:45.117127    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 00:43:45.439636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:45.439545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:45.657312 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:45.657280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:45.800320 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:45.800290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:45.884718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:45.884662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:46.119993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:46.119921    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:46.120348 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:46.120249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:46.120853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:46.120833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:43:47.778704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:47.778638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:48.444255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:48.444220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:49.131511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:49.131474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:49.507605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:49.507515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:49.818735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:49.817986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:49.987185 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:49.987145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:50.188386 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:50.188300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:51.409814 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:51.409790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:43:52.785213 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:52.785175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:55.389336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.389307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:55.490677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.490601    2578 generic.go:356] "Generic (PLEG): container finished" podID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerID="51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0" exitCode=0
Sep 08 00:43:55.490677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.490675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" event={"ID":"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa","Type":"ContainerDied","Data":"51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"}
Sep 08 00:43:55.491143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.491124    2578 scope.go:117] "RemoveContainer" containerID="51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"
Sep 08 00:43:55.492328 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.492299    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:55.492400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.492373    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:55.492438 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:55.492403    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:43:56.278089 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:56.278004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:56.375305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:56.375271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:56.502579 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:56.502538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" event={"ID":"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa","Type":"ContainerStarted","Data":"ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84"}
Sep 08 00:43:56.837858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:56.837821    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:43:56.838037 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:56.838001    2578 patch_prober.go:28] interesting pod/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 08 00:43:56.838082 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:56.838055    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 08 00:43:57.401526 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:57.401467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:57.563326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:57.563274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:57.663881 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:57.663779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:57.763432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:57.763399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:57.837952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:57.837919    2578 patch_prober.go:28] interesting pod/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 08 00:43:57.838113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:57.837971    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 08 00:43:58.059101 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:58.059064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:58.159908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:58.159872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:43:58.837934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:58.837887    2578 patch_prober.go:28] interesting pod/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 08 00:43:58.838326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:58.837966    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 08 00:43:59.837705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:59.837653    2578 patch_prober.go:28] interesting pod/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 08 00:43:59.837871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:43:59.837747    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 08 00:44:00.281737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:00.281569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:00.838071 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:00.838035    2578 patch_prober.go:28] interesting pod/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 08 00:44:00.838244 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:00.838101    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 08 00:44:01.843301 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:01.843271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:44:01.843677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:01.843653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:44:01.844395 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:01.844372    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:44:01.926737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:01.926703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:18.593864 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.593825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:18.631030 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.630980    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"]
Sep 08 00:44:18.631232 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.631203    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh" podUID="5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" containerName="payload-pre-processing" containerID="cri-o://cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a" gracePeriod=30
Sep 08 00:44:18.694738 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.694649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:18.790384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.790346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:18.841599 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.841569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:18.915620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.915591    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:44:18.953952 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:18.953918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:19.008940 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.008910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbllz\" (UniqueName: \"kubernetes.io/projected/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-kube-api-access-sbllz\") pod \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") "
Sep 08 00:44:19.009081 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.008966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-plugins-config-volume\") pod \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\" (UID: \"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10\") "
Sep 08 00:44:19.009361 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.009338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" (UID: "5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:44:19.011172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.011152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-kube-api-access-sbllz" (OuterVolumeSpecName: "kube-api-access-sbllz") pod "5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" (UID: "5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10"). InnerVolumeSpecName "kube-api-access-sbllz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:44:19.109858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.109820    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbllz\" (UniqueName: \"kubernetes.io/projected/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-kube-api-access-sbllz\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:44:19.109858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.109851    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:44:19.420042 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.419997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:19.526720 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.526676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:19.628285 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.628255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:19.671908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.671831    2578 generic.go:356] "Generic (PLEG): container finished" podID="5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" containerID="cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a" exitCode=0
Sep 08 00:44:19.671908 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.671875    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"
Sep 08 00:44:19.672081 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.671924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh" event={"ID":"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10","Type":"ContainerDied","Data":"cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a"}
Sep 08 00:44:19.672081 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.671970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh" event={"ID":"5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10","Type":"ContainerDied","Data":"7deeb80f0d1939dd1c709041d32415165bc0a6c5aafaf02594a47a8a7e82f553"}
Sep 08 00:44:19.672081 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.671992    2578 scope.go:117] "RemoveContainer" containerID="cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a"
Sep 08 00:44:19.685339 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.685320    2578 scope.go:117] "RemoveContainer" containerID="cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a"
Sep 08 00:44:19.685630 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:44:19.685613    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a\": container with ID starting with cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a not found: ID does not exist" containerID="cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a"
Sep 08 00:44:19.685722 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.685637    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a"} err="failed to get container status \"cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a\": rpc error: code = NotFound desc = could not find container \"cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a\": container with ID starting with cc9c708cd9167b06570d65383ea46407dd82169a84b17c1818785e8fc793409a not found: ID does not exist"
Sep 08 00:44:19.698226 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.698204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"]
Sep 08 00:44:19.702345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.702324    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3b0b8262-65f774f55d-9zbzh"]
Sep 08 00:44:19.775313 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.775286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:19.906096 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.906065    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"]
Sep 08 00:44:19.906795 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.906775    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" containerName="payload-pre-processing"
Sep 08 00:44:19.906876 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.906798    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" containerName="payload-pre-processing"
Sep 08 00:44:19.906933 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.906908    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" containerName="payload-pre-processing"
Sep 08 00:44:19.910047 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.910026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:19.912731 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.912706    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3790db3d-gw-openshift-default-dockercfg-fdcnk\""
Sep 08 00:44:19.920907 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.920717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"]
Sep 08 00:44:19.937138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:19.937079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:20.020110 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0d10680-1e85-46db-887b-e9b8f311f02f-istiod-ca-cert\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-certs\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-podinfo\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-credential-socket\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-token\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7bw5\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-kube-api-access-z7bw5\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-envoy\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-data\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.020489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.020476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-socket\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.059157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.059128    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10" path="/var/lib/kubelet/pods/5b3aaaa5-d6b3-4cc5-8f20-8a37d50d7d10/volumes"
Sep 08 00:44:20.121595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.121564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-podinfo\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.121762 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.121746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-credential-socket\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.121826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.121788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-token\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.121960 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.121932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7bw5\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-kube-api-access-z7bw5\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.121979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-envoy\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-data\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-socket\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0d10680-1e85-46db-887b-e9b8f311f02f-istiod-ca-cert\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-credential-socket\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-certs\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122426 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-data\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-socket\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122588 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-certs\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.122927 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.122904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0d10680-1e85-46db-887b-e9b8f311f02f-istiod-ca-cert\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.124215 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.124192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-podinfo\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.124375 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.124357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-envoy\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.129777 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.129757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-token\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.130143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.130120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7bw5\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-kube-api-access-z7bw5\") pod \"e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") " pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.222845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.222793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:20.488747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.488642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:20.511183 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.511157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"]
Sep 08 00:44:20.512904 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:44:20.512871    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d10680_1e85_46db_887b_e9b8f311f02f.slice/crio-32d16642eb25efa61768de7dd3c7291826e9a22e0ad444aa81b5868853d9eee2 WatchSource:0}: Error finding container 32d16642eb25efa61768de7dd3c7291826e9a22e0ad444aa81b5868853d9eee2: Status 404 returned error can't find the container with id 32d16642eb25efa61768de7dd3c7291826e9a22e0ad444aa81b5868853d9eee2
Sep 08 00:44:20.515277 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.515240    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:20.515358 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.515308    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:20.515358 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.515343    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:20.681676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.681610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" event={"ID":"b0d10680-1e85-46db-887b-e9b8f311f02f","Type":"ContainerStarted","Data":"af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"}
Sep 08 00:44:20.681676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.681669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" event={"ID":"b0d10680-1e85-46db-887b-e9b8f311f02f","Type":"ContainerStarted","Data":"32d16642eb25efa61768de7dd3c7291826e9a22e0ad444aa81b5868853d9eee2"}
Sep 08 00:44:20.705253 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:20.705187    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" podStartSLOduration=1.705167262 podStartE2EDuration="1.705167262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:44:20.702199733 +0000 UTC m=+683.080573167" watchObservedRunningTime="2026-09-08 00:44:20.705167262 +0000 UTC m=+683.083540696"
Sep 08 00:44:21.222960 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:21.222925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:21.227603 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:21.227576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:21.346348 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:21.346313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:21.688004 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:21.687969    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:21.688756 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:21.688734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:22.166301 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.166260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:22.271777 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.271744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:22.423553 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.423454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:22.797530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.797495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:22.899435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.899395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:22.928271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.928238    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"]
Sep 08 00:44:22.931781 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.931757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:22.934605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.934583    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3790db3d\""
Sep 08 00:44:22.934740 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.934646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3790db3d-dockercfg-lc468\""
Sep 08 00:44:22.942617 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.942594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"]
Sep 08 00:44:22.985916 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:22.985875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:23.055181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.055085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rn2v\" (UniqueName: \"kubernetes.io/projected/200e3ba2-e345-4948-8143-283004543a21-kube-api-access-9rn2v\") pod \"payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") " pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.055457 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.055432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200e3ba2-e345-4948-8143-283004543a21-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") " pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.156838 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.156803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rn2v\" (UniqueName: \"kubernetes.io/projected/200e3ba2-e345-4948-8143-283004543a21-kube-api-access-9rn2v\") pod \"payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") " pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.156838 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.156843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200e3ba2-e345-4948-8143-283004543a21-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") " pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.157505 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.157486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200e3ba2-e345-4948-8143-283004543a21-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") " pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.165292 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.165262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rn2v\" (UniqueName: \"kubernetes.io/projected/200e3ba2-e345-4948-8143-283004543a21-kube-api-access-9rn2v\") pod \"payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") " pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.245122 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.245095    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.518053 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.518027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"]
Sep 08 00:44:23.518974 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:44:23.518950    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200e3ba2_e345_4948_8143_283004543a21.slice/crio-e4f542011a63e8ee2fe0057e40ad077c750a225f3d9ab41a9605c3f7f9988e21 WatchSource:0}: Error finding container e4f542011a63e8ee2fe0057e40ad077c750a225f3d9ab41a9605c3f7f9988e21: Status 404 returned error can't find the container with id e4f542011a63e8ee2fe0057e40ad077c750a225f3d9ab41a9605c3f7f9988e21
Sep 08 00:44:23.701590 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.701557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc" event={"ID":"200e3ba2-e345-4948-8143-283004543a21","Type":"ContainerStarted","Data":"b2a06c1c337c4711fbcb311682d978ed05d9cfeef94360314c6454f8aa807b30"}
Sep 08 00:44:23.701854 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.701619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc" event={"ID":"200e3ba2-e345-4948-8143-283004543a21","Type":"ContainerStarted","Data":"e4f542011a63e8ee2fe0057e40ad077c750a225f3d9ab41a9605c3f7f9988e21"}
Sep 08 00:44:23.701944 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.701875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:23.722317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:23.722264    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc" podStartSLOduration=1.722251568 podStartE2EDuration="1.722251568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:44:23.720663647 +0000 UTC m=+686.099037091" watchObservedRunningTime="2026-09-08 00:44:23.722251568 +0000 UTC m=+686.100625001"
Sep 08 00:44:30.343241 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:30.343207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:34.709820 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:34.709787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:45.572054 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:45.572014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:47.353584 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:47.353548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:48.865096 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:48.865061    2578 generic.go:356] "Generic (PLEG): container finished" podID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerID="af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed" exitCode=0
Sep 08 00:44:48.865550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:48.865120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" event={"ID":"b0d10680-1e85-46db-887b-e9b8f311f02f","Type":"ContainerDied","Data":"af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"}
Sep 08 00:44:48.865550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:48.865487    2578 scope.go:117] "RemoveContainer" containerID="af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"
Sep 08 00:44:48.866694 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:48.866649    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:48.866768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:48.866745    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:48.866805 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:48.866776    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:49.889708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:49.887079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" event={"ID":"b0d10680-1e85-46db-887b-e9b8f311f02f","Type":"ContainerStarted","Data":"42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e"}
Sep 08 00:44:50.223144 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:50.223051    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:50.224473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:50.224445    2578 patch_prober.go:28] interesting pod/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 08 00:44:50.224599 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:50.224498    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 08 00:44:51.223246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:51.223170    2578 patch_prober.go:28] interesting pod/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 08 00:44:51.223246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:51.223229    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 08 00:44:51.688188 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:51.688148    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:44:52.223451 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:52.223416    2578 patch_prober.go:28] interesting pod/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 08 00:44:52.223870 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:52.223464    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 08 00:44:53.223972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.223934    2578 patch_prober.go:28] interesting pod/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 08 00:44:53.224433 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.224003    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 08 00:44:53.609211 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.609172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:53.656255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.656221    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"]
Sep 08 00:44:53.656744 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.656714    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc" podUID="200e3ba2-e345-4948-8143-283004543a21" containerName="payload-processing" containerID="cri-o://b2a06c1c337c4711fbcb311682d978ed05d9cfeef94360314c6454f8aa807b30" gracePeriod=30
Sep 08 00:44:53.710778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.710483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:53.810092 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.810063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:53.914761 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.914275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:53.924221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.924191    2578 generic.go:356] "Generic (PLEG): container finished" podID="200e3ba2-e345-4948-8143-283004543a21" containerID="b2a06c1c337c4711fbcb311682d978ed05d9cfeef94360314c6454f8aa807b30" exitCode=0
Sep 08 00:44:53.924389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.924253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc" event={"ID":"200e3ba2-e345-4948-8143-283004543a21","Type":"ContainerDied","Data":"b2a06c1c337c4711fbcb311682d978ed05d9cfeef94360314c6454f8aa807b30"}
Sep 08 00:44:53.960760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.960727    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"]
Sep 08 00:44:53.960994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:53.960969    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy" containerID="cri-o://42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e" gracePeriod=30
Sep 08 00:44:54.008702 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.008203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:54.015777 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.015758    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:54.065704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.064716    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rn2v\" (UniqueName: \"kubernetes.io/projected/200e3ba2-e345-4948-8143-283004543a21-kube-api-access-9rn2v\") pod \"200e3ba2-e345-4948-8143-283004543a21\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") "
Sep 08 00:44:54.065704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.064833    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200e3ba2-e345-4948-8143-283004543a21-plugins-config-volume\") pod \"200e3ba2-e345-4948-8143-283004543a21\" (UID: \"200e3ba2-e345-4948-8143-283004543a21\") "
Sep 08 00:44:54.065704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.065563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200e3ba2-e345-4948-8143-283004543a21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "200e3ba2-e345-4948-8143-283004543a21" (UID: "200e3ba2-e345-4948-8143-283004543a21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:44:54.107706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.097849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200e3ba2-e345-4948-8143-283004543a21-kube-api-access-9rn2v" (OuterVolumeSpecName: "kube-api-access-9rn2v") pod "200e3ba2-e345-4948-8143-283004543a21" (UID: "200e3ba2-e345-4948-8143-283004543a21"). InnerVolumeSpecName "kube-api-access-9rn2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:44:54.166676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.166601    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rn2v\" (UniqueName: \"kubernetes.io/projected/200e3ba2-e345-4948-8143-283004543a21-kube-api-access-9rn2v\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:44:54.166676 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.166629    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200e3ba2-e345-4948-8143-283004543a21-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:44:54.404985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.404949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:54.700356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.700318    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"]
Sep 08 00:44:54.701094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.701069    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200e3ba2-e345-4948-8143-283004543a21" containerName="payload-processing"
Sep 08 00:44:54.701210 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.701096    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="200e3ba2-e345-4948-8143-283004543a21" containerName="payload-processing"
Sep 08 00:44:54.701268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.701220    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="200e3ba2-e345-4948-8143-283004543a21" containerName="payload-processing"
Sep 08 00:44:54.703890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.703870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.711062 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.710001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f80520f6-openshift-default-dockercfg-nlbfn\""
Sep 08 00:44:54.711873 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.711750    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"]
Sep 08 00:44:54.719904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.718719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:54.773399 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-envoy\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-credential-socket\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608f702e-a035-42e8-901d-1aeb11431601-istiod-ca-cert\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h466k\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-kube-api-access-h466k\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-istio-token\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-socket\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-data\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608f702e-a035-42e8-901d-1aeb11431601-istio-podinfo\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.773890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.773790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-certs\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.874984 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.874937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608f702e-a035-42e8-901d-1aeb11431601-istio-podinfo\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-certs\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-envoy\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-credential-socket\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608f702e-a035-42e8-901d-1aeb11431601-istiod-ca-cert\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h466k\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-kube-api-access-h466k\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-istio-token\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-socket\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875548 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-data\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875927 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-certs\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.875927 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-data\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.876107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.875926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-socket\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.876107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.876019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-credential-socket\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.876423 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.876398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608f702e-a035-42e8-901d-1aeb11431601-istiod-ca-cert\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.878918 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.878888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-envoy\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.879075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.879056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608f702e-a035-42e8-901d-1aeb11431601-istio-podinfo\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.883593 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.883552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h466k\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-kube-api-access-h466k\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.884159 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.884142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-istio-token\") pod \"e2e-ait-f80520f6-openshift-default-6d546f6654-977jq\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") " pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:54.931051 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.931021    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"
Sep 08 00:44:54.931177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.931057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc" event={"ID":"200e3ba2-e345-4948-8143-283004543a21","Type":"ContainerDied","Data":"e4f542011a63e8ee2fe0057e40ad077c750a225f3d9ab41a9605c3f7f9988e21"}
Sep 08 00:44:54.931177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.931120    2578 scope.go:117] "RemoveContainer" containerID="b2a06c1c337c4711fbcb311682d978ed05d9cfeef94360314c6454f8aa807b30"
Sep 08 00:44:54.937821 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.937790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:54.954273 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.954224    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"]
Sep 08 00:44:54.957575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:54.957554    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3790db3d-8448b799db-7kkjc"]
Sep 08 00:44:55.024734 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.024699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:55.304942 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.304905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"]
Sep 08 00:44:55.307903 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:44:55.307877    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608f702e_a035_42e8_901d_1aeb11431601.slice/crio-bd232e052093ea64fa77c45cd831e37a54a53bc0b207c8b1c5800851de3588c4 WatchSource:0}: Error finding container bd232e052093ea64fa77c45cd831e37a54a53bc0b207c8b1c5800851de3588c4: Status 404 returned error can't find the container with id bd232e052093ea64fa77c45cd831e37a54a53bc0b207c8b1c5800851de3588c4
Sep 08 00:44:55.312954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.312274    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:55.312954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.312366    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:55.312954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.312406    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:44:55.939763 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.939728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" event={"ID":"608f702e-a035-42e8-901d-1aeb11431601","Type":"ContainerStarted","Data":"89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"}
Sep 08 00:44:55.940115 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.939786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" event={"ID":"608f702e-a035-42e8-901d-1aeb11431601","Type":"ContainerStarted","Data":"bd232e052093ea64fa77c45cd831e37a54a53bc0b207c8b1c5800851de3588c4"}
Sep 08 00:44:55.959241 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:55.959195    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podStartSLOduration=1.959180667 podStartE2EDuration="1.959180667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:44:55.958661566 +0000 UTC m=+718.337035012" watchObservedRunningTime="2026-09-08 00:44:55.959180667 +0000 UTC m=+718.337554124"
Sep 08 00:44:56.025823 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:56.025742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:56.028023 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:56.027992    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:44:56.028178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:56.028054    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 00:44:56.059200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:56.059165    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200e3ba2-e345-4948-8143-283004543a21" path="/var/lib/kubelet/pods/200e3ba2-e345-4948-8143-283004543a21/volumes"
Sep 08 00:44:57.030783 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:57.030747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:57.291889 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:57.291796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:57.385272 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:57.385233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:57.952434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:57.952403    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:57.953256 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:57.953235    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:44:58.614006 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:58.613974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:58.714923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:58.714877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:58.814570 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:58.814536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:59.187607 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:59.187566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:44:59.300264 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:44:59.300200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:00.116310 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.116280    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:45:00.231393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231318    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-data\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231367    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0d10680-1e85-46db-887b-e9b8f311f02f-istiod-ca-cert\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231386    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7bw5\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-kube-api-access-z7bw5\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231405    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-socket\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231440    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-podinfo\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-token\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-credential-socket\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231581    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-certs\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-envoy\") pod \"b0d10680-1e85-46db-887b-e9b8f311f02f\" (UID: \"b0d10680-1e85-46db-887b-e9b8f311f02f\") "
Sep 08 00:45:00.231663 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231639    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:00.232064 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:00.232064 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d10680-1e85-46db-887b-e9b8f311f02f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:45:00.232064 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.231905    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:00.232064 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.232047    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:00.232278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.232166    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0d10680-1e85-46db-887b-e9b8f311f02f-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.232278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.232186    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.232278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.232201    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.232278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.232214    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.232278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.232228    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.233855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.233828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:45:00.233979 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.233920    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-kube-api-access-z7bw5" (OuterVolumeSpecName: "kube-api-access-z7bw5") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "kube-api-access-z7bw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:45:00.233979 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.233930    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:45:00.234057 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.234020    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0d10680-1e85-46db-887b-e9b8f311f02f" (UID: "b0d10680-1e85-46db-887b-e9b8f311f02f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:00.333282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.333251    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.333282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.333276    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7bw5\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-kube-api-access-z7bw5\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.333432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.333291    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.333432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.333303    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0d10680-1e85-46db-887b-e9b8f311f02f-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:00.970938 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.970899    2578 generic.go:356] "Generic (PLEG): container finished" podID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerID="42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e" exitCode=0
Sep 08 00:45:00.971104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.970970    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"
Sep 08 00:45:00.971104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.970978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" event={"ID":"b0d10680-1e85-46db-887b-e9b8f311f02f","Type":"ContainerDied","Data":"42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e"}
Sep 08 00:45:00.971104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.971061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln" event={"ID":"b0d10680-1e85-46db-887b-e9b8f311f02f","Type":"ContainerDied","Data":"32d16642eb25efa61768de7dd3c7291826e9a22e0ad444aa81b5868853d9eee2"}
Sep 08 00:45:00.971104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.971086    2578 scope.go:117] "RemoveContainer" containerID="42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e"
Sep 08 00:45:00.981867 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.981762    2578 scope.go:117] "RemoveContainer" containerID="af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"
Sep 08 00:45:00.989954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.989932    2578 scope.go:117] "RemoveContainer" containerID="42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e"
Sep 08 00:45:00.990226 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:45:00.990203    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e\": container with ID starting with 42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e not found: ID does not exist" containerID="42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e"
Sep 08 00:45:00.990309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.990231    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e"} err="failed to get container status \"42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e\": rpc error: code = NotFound desc = could not find container \"42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e\": container with ID starting with 42da4dc76740de5c000be5249e339b9c9c584034bad208134c0687c0a39c312e not found: ID does not exist"
Sep 08 00:45:00.990309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.990247    2578 scope.go:117] "RemoveContainer" containerID="af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"
Sep 08 00:45:00.990505 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:45:00.990486    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed\": container with ID starting with af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed not found: ID does not exist" containerID="af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"
Sep 08 00:45:00.990544 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.990510    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed"} err="failed to get container status \"af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed\": rpc error: code = NotFound desc = could not find container \"af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed\": container with ID starting with af64986ab092d98ff3016f5389e922734bc96c584afe6c210f230e73ad3390ed not found: ID does not exist"
Sep 08 00:45:00.995449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:00.995426    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"]
Sep 08 00:45:01.000472 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:01.000452    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3790db3d-gw-openshift-default-77d66f47d4-k5nln"]
Sep 08 00:45:02.058009 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:02.057975    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" path="/var/lib/kubelet/pods/b0d10680-1e85-46db-887b-e9b8f311f02f/volumes"
Sep 08 00:45:13.993819 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:13.993777    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:45:13.994224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:13.993829    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:45:16.068643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.068608    2578 generic.go:356] "Generic (PLEG): container finished" podID="608f702e-a035-42e8-901d-1aeb11431601" containerID="89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c" exitCode=0
Sep 08 00:45:16.069127 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.068678    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" event={"ID":"608f702e-a035-42e8-901d-1aeb11431601","Type":"ContainerDied","Data":"89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"}
Sep 08 00:45:16.069127 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.069075    2578 scope.go:117] "RemoveContainer" containerID="89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"
Sep 08 00:45:16.070235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.070209    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:45:16.070309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.070285    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:45:16.070349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.070331    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:45:16.531545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:16.531465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:17.078342 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:17.078285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" event={"ID":"608f702e-a035-42e8-901d-1aeb11431601","Type":"ContainerStarted","Data":"9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e"}
Sep 08 00:45:18.025025 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:18.024991    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:45:18.025218 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:18.025196    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:45:18.025267 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:18.025242    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 00:45:19.025838 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:19.025803    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:45:19.026212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:19.025864    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 00:45:20.025069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:20.025036    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:45:20.025242 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:20.025096    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 00:45:21.025569 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:21.025537    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:45:21.026030 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:21.025809    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 00:45:22.025384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:22.025344    2578 patch_prober.go:28] interesting pod/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:45:22.025557 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:22.025396    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 00:45:23.029378 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:23.029349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:45:23.029800 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:23.029637    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:45:23.030376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:23.030358    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:45:29.025098 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:29.025063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:29.095353 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:29.095315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:29.157819 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:29.157786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:29.237907 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:29.237879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:29.303349 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:29.303319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:30.334554 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:30.334519    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"]
Sep 08 00:45:30.335067 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:30.334750    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy" containerID="cri-o://9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e" gracePeriod=30
Sep 08 00:45:30.357917 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:30.357880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:30.758621 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:30.758533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:31.037233 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.037160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"]
Sep 08 00:45:31.037660 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.037647    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy"
Sep 08 00:45:31.037736 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.037663    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy"
Sep 08 00:45:31.037802 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.037791    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy"
Sep 08 00:45:31.037839 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.037802    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy"
Sep 08 00:45:31.041106 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.041085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.043593 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.043572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9b001d57-openshift-default-dockercfg-gv9gd\""
Sep 08 00:45:31.053219 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.053198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"]
Sep 08 00:45:31.065599 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.065571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:31.164033 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.163979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-podinfo\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164231 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-envoy\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164231 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0445258-b8d9-4422-9e16-02e0d0d73a87-istiod-ca-cert\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164231 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-data\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164231 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-socket\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-certs\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xpjt\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-kube-api-access-8xpjt\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-credential-socket\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.164456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.164398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-token\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266025 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.265997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-data\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-socket\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-certs\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xpjt\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-kube-api-access-8xpjt\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-credential-socket\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-token\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-podinfo\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-envoy\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0445258-b8d9-4422-9e16-02e0d0d73a87-istiod-ca-cert\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-data\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266616 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-socket\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266757 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-credential-socket\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.266892 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.266870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-certs\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.267079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.267046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0445258-b8d9-4422-9e16-02e0d0d73a87-istiod-ca-cert\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.269204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.269179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-envoy\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.269506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.269483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-podinfo\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.274989 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.274960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-token\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.275073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.275060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xpjt\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-kube-api-access-8xpjt\") pod \"e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") " pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.352174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.352153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:31.366652 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.366615    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:31.635974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.635951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"]
Sep 08 00:45:31.638269 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:45:31.638237    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0445258_b8d9_4422_9e16_02e0d0d73a87.slice/crio-1cad5ba1713da9c1dd9d658e440770c2ccf9140b85a1899d995e05e95f7d0e34 WatchSource:0}: Error finding container 1cad5ba1713da9c1dd9d658e440770c2ccf9140b85a1899d995e05e95f7d0e34: Status 404 returned error can't find the container with id 1cad5ba1713da9c1dd9d658e440770c2ccf9140b85a1899d995e05e95f7d0e34
Sep 08 00:45:31.640736 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.640678    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:45:31.640836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.640769    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:45:31.640836 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:31.640798    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:45:32.181926 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:32.181884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" event={"ID":"b0445258-b8d9-4422-9e16-02e0d0d73a87","Type":"ContainerStarted","Data":"dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"}
Sep 08 00:45:32.182153 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:32.181954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" event={"ID":"b0445258-b8d9-4422-9e16-02e0d0d73a87","Type":"ContainerStarted","Data":"1cad5ba1713da9c1dd9d658e440770c2ccf9140b85a1899d995e05e95f7d0e34"}
Sep 08 00:45:32.202968 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:32.202923    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" podStartSLOduration=1.202907427 podStartE2EDuration="1.202907427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:45:32.201668876 +0000 UTC m=+754.580042309" watchObservedRunningTime="2026-09-08 00:45:32.202907427 +0000 UTC m=+754.581280862"
Sep 08 00:45:32.353309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:32.353276    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:32.358383 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:32.358358    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:33.188656 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:33.188621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:33.189534 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:33.189508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:45:33.533015 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:33.532929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:33.622261 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:33.622226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:34.863380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:34.863349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:34.964675 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:34.964641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:35.062739 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.062702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:35.435178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.435150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:35.535892 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.535859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:35.601130 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.601067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:45:35.711966 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.711934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h466k\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-kube-api-access-h466k\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608f702e-a035-42e8-901d-1aeb11431601-istiod-ca-cert\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-certs\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608f702e-a035-42e8-901d-1aeb11431601-istio-podinfo\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-socket\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-credential-socket\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-data\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-istio-token\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:35.712473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-envoy\") pod \"608f702e-a035-42e8-901d-1aeb11431601\" (UID: \"608f702e-a035-42e8-901d-1aeb11431601\") "
Sep 08 00:45:35.712473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712377    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:35.712651 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712485    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-data" (OuterVolumeSpecName: "istio-data") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:35.712651 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712501    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:35.712651 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712523    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/608f702e-a035-42e8-901d-1aeb11431601-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:45:35.712842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712824    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.712902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712846    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608f702e-a035-42e8-901d-1aeb11431601-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.712902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712860    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.712902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712872    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.712902 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.712884    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.714486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.714457    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-istio-token" (OuterVolumeSpecName: "istio-token") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:45:35.714648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.714629    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-kube-api-access-h466k" (OuterVolumeSpecName: "kube-api-access-h466k") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "kube-api-access-h466k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:45:35.714741 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.714727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/608f702e-a035-42e8-901d-1aeb11431601-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:45:35.714821 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.714803    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "608f702e-a035-42e8-901d-1aeb11431601" (UID: "608f702e-a035-42e8-901d-1aeb11431601"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:45:35.814434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.814410    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.814434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.814430    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608f702e-a035-42e8-901d-1aeb11431601-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.814583 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.814441    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h466k\" (UniqueName: \"kubernetes.io/projected/608f702e-a035-42e8-901d-1aeb11431601-kube-api-access-h466k\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:35.814583 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:35.814449    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608f702e-a035-42e8-901d-1aeb11431601-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:45:36.208859 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.208823    2578 generic.go:356] "Generic (PLEG): container finished" podID="608f702e-a035-42e8-901d-1aeb11431601" containerID="9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e" exitCode=0
Sep 08 00:45:36.209230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.208923    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"
Sep 08 00:45:36.209230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.208965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" event={"ID":"608f702e-a035-42e8-901d-1aeb11431601","Type":"ContainerDied","Data":"9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e"}
Sep 08 00:45:36.209230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.209030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq" event={"ID":"608f702e-a035-42e8-901d-1aeb11431601","Type":"ContainerDied","Data":"bd232e052093ea64fa77c45cd831e37a54a53bc0b207c8b1c5800851de3588c4"}
Sep 08 00:45:36.209230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.209067    2578 scope.go:117] "RemoveContainer" containerID="9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e"
Sep 08 00:45:36.218471 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.218454    2578 scope.go:117] "RemoveContainer" containerID="89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"
Sep 08 00:45:36.226496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.226477    2578 scope.go:117] "RemoveContainer" containerID="9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e"
Sep 08 00:45:36.226814 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:45:36.226793    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e\": container with ID starting with 9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e not found: ID does not exist" containerID="9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e"
Sep 08 00:45:36.226895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.226821    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e"} err="failed to get container status \"9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e\": rpc error: code = NotFound desc = could not find container \"9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e\": container with ID starting with 9869429766ebaf0d8406efc14248fb61324c9fdbf5236517a0c1bc5e6a9da27e not found: ID does not exist"
Sep 08 00:45:36.226895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.226840    2578 scope.go:117] "RemoveContainer" containerID="89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"
Sep 08 00:45:36.227088 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:45:36.227067    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c\": container with ID starting with 89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c not found: ID does not exist" containerID="89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"
Sep 08 00:45:36.227146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.227093    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c"} err="failed to get container status \"89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c\": rpc error: code = NotFound desc = could not find container \"89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c\": container with ID starting with 89308303e427989f6e8f2657abc153e024e128a66e7c4f2dbcc11a7cdbd6fc3c not found: ID does not exist"
Sep 08 00:45:36.228101 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.228081    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"]
Sep 08 00:45:36.233376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:36.233357    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f80520f6-openshift-default-6d546f6654-977jq"]
Sep 08 00:45:38.058425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:38.058387    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="608f702e-a035-42e8-901d-1aeb11431601" path="/var/lib/kubelet/pods/608f702e-a035-42e8-901d-1aeb11431601/volumes"
Sep 08 00:45:51.729344 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:51.729289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:45:56.546657 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:45:56.546619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:00.362232 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:00.362201    2578 generic.go:356] "Generic (PLEG): container finished" podID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerID="dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da" exitCode=0
Sep 08 00:46:00.362619 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:00.362287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" event={"ID":"b0445258-b8d9-4422-9e16-02e0d0d73a87","Type":"ContainerDied","Data":"dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"}
Sep 08 00:46:00.362728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:00.362714    2578 scope.go:117] "RemoveContainer" containerID="dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"
Sep 08 00:46:00.363826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:00.363769    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:46:00.363886 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:00.363868    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:46:00.363922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:00.363901    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:46:01.370263 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:01.370226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" event={"ID":"b0445258-b8d9-4422-9e16-02e0d0d73a87","Type":"ContainerStarted","Data":"6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38"}
Sep 08 00:46:01.634920 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:01.634818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:02.195393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.195277    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"]
Sep 08 00:46:02.195586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.195508    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8" podUID="08a94a7c-1080-4175-ae94-fbff81934964" containerName="maas-api" containerID="cri-o://84dd28cd2b939a8275a1ce047fd80fdf875a7899ab5f75a23b18c6f91123c6b8" gracePeriod=30
Sep 08 00:46:02.208449 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.208423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:02.288918 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.288885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:02.353736 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.353703    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:46:02.354574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.354466    2578 patch_prober.go:28] interesting pod/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 08 00:46:02.354574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.354528    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 08 00:46:02.358816 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.358785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:02.385048 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.384138    2578 generic.go:356] "Generic (PLEG): container finished" podID="08a94a7c-1080-4175-ae94-fbff81934964" containerID="84dd28cd2b939a8275a1ce047fd80fdf875a7899ab5f75a23b18c6f91123c6b8" exitCode=0
Sep 08 00:46:02.385048 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.384986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8" event={"ID":"08a94a7c-1080-4175-ae94-fbff81934964","Type":"ContainerDied","Data":"84dd28cd2b939a8275a1ce047fd80fdf875a7899ab5f75a23b18c6f91123c6b8"}
Sep 08 00:46:02.459817 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.459729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:02.528271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.527960    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:46:02.615103 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.615052    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a94a7c-1080-4175-ae94-fbff81934964-openshift-service-ca\") pod \"08a94a7c-1080-4175-ae94-fbff81934964\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") "
Sep 08 00:46:02.615268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.615196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-metrics-certs\") pod \"08a94a7c-1080-4175-ae94-fbff81934964\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") "
Sep 08 00:46:02.615268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.615243    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n54z5\" (UniqueName: \"kubernetes.io/projected/08a94a7c-1080-4175-ae94-fbff81934964-kube-api-access-n54z5\") pod \"08a94a7c-1080-4175-ae94-fbff81934964\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") "
Sep 08 00:46:02.615404 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.615305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-maas-api-tls\") pod \"08a94a7c-1080-4175-ae94-fbff81934964\" (UID: \"08a94a7c-1080-4175-ae94-fbff81934964\") "
Sep 08 00:46:02.616206 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.616171    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08a94a7c-1080-4175-ae94-fbff81934964-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08a94a7c-1080-4175-ae94-fbff81934964" (UID: "08a94a7c-1080-4175-ae94-fbff81934964"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:46:02.618050 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.618023    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08a94a7c-1080-4175-ae94-fbff81934964" (UID: "08a94a7c-1080-4175-ae94-fbff81934964"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:46:02.618283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.618256    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "08a94a7c-1080-4175-ae94-fbff81934964" (UID: "08a94a7c-1080-4175-ae94-fbff81934964"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:46:02.618388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.618307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a94a7c-1080-4175-ae94-fbff81934964-kube-api-access-n54z5" (OuterVolumeSpecName: "kube-api-access-n54z5") pod "08a94a7c-1080-4175-ae94-fbff81934964" (UID: "08a94a7c-1080-4175-ae94-fbff81934964"). InnerVolumeSpecName "kube-api-access-n54z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:46:02.716545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.716462    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-maas-api-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:02.716545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.716491    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a94a7c-1080-4175-ae94-fbff81934964-openshift-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:02.716545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.716502    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a94a7c-1080-4175-ae94-fbff81934964-metrics-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:02.716545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.716511    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n54z5\" (UniqueName: \"kubernetes.io/projected/08a94a7c-1080-4175-ae94-fbff81934964-kube-api-access-n54z5\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:02.735498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:02.735462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:03.188982 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.188947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:46:03.353053 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.353020    2578 patch_prober.go:28] interesting pod/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 08 00:46:03.353212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.353099    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 08 00:46:03.395697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.395641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"
Sep 08 00:46:03.398973 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.398943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8" event={"ID":"08a94a7c-1080-4175-ae94-fbff81934964","Type":"ContainerDied","Data":"610bfdcced0b84b1807300f6e5c586ca636aaeb14147741ffa0196cff786048b"}
Sep 08 00:46:03.399098 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.399008    2578 scope.go:117] "RemoveContainer" containerID="84dd28cd2b939a8275a1ce047fd80fdf875a7899ab5f75a23b18c6f91123c6b8"
Sep 08 00:46:03.422167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.422144    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"]
Sep 08 00:46:03.425567 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:03.425547    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-31f424-7f6c674cc8-g77m8"]
Sep 08 00:46:04.057569 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:04.057536    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08a94a7c-1080-4175-ae94-fbff81934964" path="/var/lib/kubelet/pods/08a94a7c-1080-4175-ae94-fbff81934964/volumes"
Sep 08 00:46:04.353298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:04.353212    2578 patch_prober.go:28] interesting pod/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 08 00:46:04.353298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:04.353266    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 08 00:46:04.955456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:04.955419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:05.352830 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:05.352790    2578 patch_prober.go:28] interesting pod/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 08 00:46:05.353028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:05.352855    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 08 00:46:05.534316 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:05.534236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:05.599148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:05.599078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:05.834611 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:05.834579    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"]
Sep 08 00:46:05.834848 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:05.834822    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy" containerID="cri-o://6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38" gracePeriod=30
Sep 08 00:46:06.073561 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:06.073527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:06.174585 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:06.174498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:06.487014 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:06.486913    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:06.582340 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:06.582288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:06.682084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:06.682053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:07.824165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:07.824129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:07.921263 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:07.921233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:11.626120 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.626057    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:46:11.705533 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-podinfo\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-data\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-socket\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-credential-socket\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xpjt\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-kube-api-access-8xpjt\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-envoy\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705762    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-token\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.705923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705781    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-certs\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.706236 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:46:11.706335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705913    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:46:11.706335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.705932    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:46:11.706335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706050    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:46:11.706335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706218    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0445258-b8d9-4422-9e16-02e0d0d73a87-istiod-ca-cert\") pod \"b0445258-b8d9-4422-9e16-02e0d0d73a87\" (UID: \"b0445258-b8d9-4422-9e16-02e0d0d73a87\") "
Sep 08 00:46:11.706555 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706504    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0445258-b8d9-4422-9e16-02e0d0d73a87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:46:11.706801 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706780    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.706904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706805    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.706904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706820    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.706904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706835    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.706904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.706849    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0445258-b8d9-4422-9e16-02e0d0d73a87-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.708002 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.707964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:46:11.708002 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.707985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:46:11.708163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.707981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-kube-api-access-8xpjt" (OuterVolumeSpecName: "kube-api-access-8xpjt") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "kube-api-access-8xpjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:46:11.708163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.708046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0445258-b8d9-4422-9e16-02e0d0d73a87" (UID: "b0445258-b8d9-4422-9e16-02e0d0d73a87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:46:11.808360 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.808334    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.808360 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.808358    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xpjt\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-kube-api-access-8xpjt\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.808540 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.808369    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:11.808540 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:11.808377    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0445258-b8d9-4422-9e16-02e0d0d73a87-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:46:12.455058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.454977    2578 generic.go:356] "Generic (PLEG): container finished" podID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerID="6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38" exitCode=0
Sep 08 00:46:12.455058 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.455033    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"
Sep 08 00:46:12.455221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.455059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" event={"ID":"b0445258-b8d9-4422-9e16-02e0d0d73a87","Type":"ContainerDied","Data":"6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38"}
Sep 08 00:46:12.455221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.455113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8" event={"ID":"b0445258-b8d9-4422-9e16-02e0d0d73a87","Type":"ContainerDied","Data":"1cad5ba1713da9c1dd9d658e440770c2ccf9140b85a1899d995e05e95f7d0e34"}
Sep 08 00:46:12.455221 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.455136    2578 scope.go:117] "RemoveContainer" containerID="6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38"
Sep 08 00:46:12.464303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.464286    2578 scope.go:117] "RemoveContainer" containerID="dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"
Sep 08 00:46:12.472514 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.472499    2578 scope.go:117] "RemoveContainer" containerID="6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38"
Sep 08 00:46:12.472833 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:46:12.472816    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38\": container with ID starting with 6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38 not found: ID does not exist" containerID="6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38"
Sep 08 00:46:12.472890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.472839    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38"} err="failed to get container status \"6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38\": rpc error: code = NotFound desc = could not find container \"6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38\": container with ID starting with 6695d2c684675e571354ec3da8380b7dee336febc975d6d0823d4ad7aa64bc38 not found: ID does not exist"
Sep 08 00:46:12.472890 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.472856    2578 scope.go:117] "RemoveContainer" containerID="dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"
Sep 08 00:46:12.473133 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:46:12.473117    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da\": container with ID starting with dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da not found: ID does not exist" containerID="dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"
Sep 08 00:46:12.473182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.473135    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da"} err="failed to get container status \"dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da\": rpc error: code = NotFound desc = could not find container \"dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da\": container with ID starting with dbb4fde904dd13ccbd84da6220e26ac15db8b0410ae2a6de7f69dd9acb2012da not found: ID does not exist"
Sep 08 00:46:12.474026 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.474005    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"]
Sep 08 00:46:12.481872 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:12.481851    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9b001d57-openshift-default-666cdd87f6-pmhb8"]
Sep 08 00:46:13.617252 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:13.617221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:13.722368 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:13.722336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:13.817473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:13.817440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:13.919843 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:13.919759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:14.057601 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:14.057569    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" path="/var/lib/kubelet/pods/b0445258-b8d9-4422-9e16-02e0d0d73a87/volumes"
Sep 08 00:46:14.271422 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:14.271339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:14.719307 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:14.719269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:14.777716 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:14.777668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:18.451309 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:18.451275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:37.830196 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:37.830155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:40.166109 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:40.166076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:44.162933 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:44.162894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:44.635303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:44.635268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:46.228167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:46.228136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:46.335465 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:46.335431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:46.470305 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:46.470256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:46:46.567284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:46:46.567238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:02.253785 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:02.253744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:07.337618 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:07.337581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:08.257401 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:08.257356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:08.368777 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:08.368737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:08.457023 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:08.456988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:11.852736 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:11.852693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:12.933846 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:12.933813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:16.159044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.159008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:16.259547 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.259497    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:16.368712 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.368667    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"]
Sep 08 00:47:16.368925 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.368882    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" containerID="cri-o://ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84" gracePeriod=30
Sep 08 00:47:16.382177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.382148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:16.786146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.786096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:16.846456 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.846416    2578 patch_prober.go:28] interesting pod/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:47:16.846609 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:16.846472    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:47:17.042537 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042513    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"]
Sep 08 00:47:17.042953 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042940    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042955    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042968    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042973    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042983    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.042989    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043002    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043007    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d10680-1e85-46db-887b-e9b8f311f02f" containerName="istio-proxy"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043015    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a94a7c-1080-4175-ae94-fbff81934964" containerName="maas-api"
Sep 08 00:47:17.043016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043020    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a94a7c-1080-4175-ae94-fbff81934964" containerName="maas-api"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043031    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043036    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043095    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043103    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0445258-b8d9-4422-9e16-02e0d0d73a87" containerName="istio-proxy"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043110    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043116    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="08a94a7c-1080-4175-ae94-fbff81934964" containerName="maas-api"
Sep 08 00:47:17.043293 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.043120    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="608f702e-a035-42e8-901d-1aeb11431601" containerName="istio-proxy"
Sep 08 00:47:17.047621 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.047605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.049989 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.049970    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-e4902f-openshift-default-dockercfg-x2wlg\""
Sep 08 00:47:17.059542 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.059522    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"]
Sep 08 00:47:17.067358 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.067335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:17.120191 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-socket\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120191 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fdb\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-kube-api-access-r2fdb\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-certs\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-credential-socket\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120567 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-data\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120567 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-podinfo\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-token\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3261ed65-9f99-407a-b896-3f7c9c543b9f-istiod-ca-cert\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.120829 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.120778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-envoy\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221330 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-credential-socket\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221330 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-data\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-podinfo\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-token\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3261ed65-9f99-407a-b896-3f7c9c543b9f-istiod-ca-cert\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-envoy\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-socket\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fdb\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-kube-api-access-r2fdb\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-certs\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.221871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-data\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.222239 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-credential-socket\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.222239 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.221967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-certs\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.222239 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.222120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-socket\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.222405 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.222288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3261ed65-9f99-407a-b896-3f7c9c543b9f-istiod-ca-cert\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.224124 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.224100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-envoy\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.224224 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.224214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-podinfo\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.229290 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.229268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-token\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.229426 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.229352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fdb\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-kube-api-access-r2fdb\") pod \"e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") " pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.359705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.359626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:17.425348 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.425311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:17.641714 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.641690    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"]
Sep 08 00:47:17.642552 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:47:17.642514    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3261ed65_9f99_407a_b896_3f7c9c543b9f.slice/crio-776ac038d98aebee368768c15eef79aecda16df0c6e98ac4f7ed0b698c4beece WatchSource:0}: Error finding container 776ac038d98aebee368768c15eef79aecda16df0c6e98ac4f7ed0b698c4beece: Status 404 returned error can't find the container with id 776ac038d98aebee368768c15eef79aecda16df0c6e98ac4f7ed0b698c4beece
Sep 08 00:47:17.644907 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.644872    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:17.645021 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.644945    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:17.645021 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.644991    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:17.843945 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.843907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" event={"ID":"3261ed65-9f99-407a-b896-3f7c9c543b9f","Type":"ContainerStarted","Data":"7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"}
Sep 08 00:47:17.844135 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.843971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" event={"ID":"3261ed65-9f99-407a-b896-3f7c9c543b9f","Type":"ContainerStarted","Data":"776ac038d98aebee368768c15eef79aecda16df0c6e98ac4f7ed0b698c4beece"}
Sep 08 00:47:17.867053 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:17.866998    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podStartSLOduration=0.866964582 podStartE2EDuration="866.964582ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:47:17.862510533 +0000 UTC m=+860.240883967" watchObservedRunningTime="2026-09-08 00:47:17.866964582 +0000 UTC m=+860.245338017"
Sep 08 00:47:18.360143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:18.360113    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:18.365252 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:18.365221    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:18.849771 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:18.849740    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:18.850587 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:18.850571    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:18.894665 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:18.894635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:19.620822 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:19.620796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:19.760554 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:19.760516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:19.867316 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:19.867275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:20.924067 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:20.924036    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"]
Sep 08 00:47:20.928334 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:20.928309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:20.930767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:20.930747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-e4902f-serving-cert\""
Sep 08 00:47:20.938695 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:20.938654    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"]
Sep 08 00:47:20.961531 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:20.961505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:21.060993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.060957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:21.063175 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.063146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27fb7345-49a1-467d-bd7f-6515d669f3b1-openshift-service-ca\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.063298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.063256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-maas-api-tls\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.063366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.063324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-metrics-certs\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.063444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.063427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h72mb\" (UniqueName: \"kubernetes.io/projected/27fb7345-49a1-467d-bd7f-6515d669f3b1-kube-api-access-h72mb\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.163794 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.163761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:21.164015 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.163997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27fb7345-49a1-467d-bd7f-6515d669f3b1-openshift-service-ca\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.164080 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.164066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-maas-api-tls\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.164123 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.164107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-metrics-certs\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.164178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.164168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h72mb\" (UniqueName: \"kubernetes.io/projected/27fb7345-49a1-467d-bd7f-6515d669f3b1-kube-api-access-h72mb\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.164656 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.164633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27fb7345-49a1-467d-bd7f-6515d669f3b1-openshift-service-ca\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.166490 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.166468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-maas-api-tls\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.166595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.166520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-metrics-certs\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.172265 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.172242    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h72mb\" (UniqueName: \"kubernetes.io/projected/27fb7345-49a1-467d-bd7f-6515d669f3b1-kube-api-access-h72mb\") pod \"maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.242378 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.242283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:21.436028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.435987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:21.532197 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.532168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"]
Sep 08 00:47:21.533610 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:47:21.533579    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fb7345_49a1_467d_bd7f_6515d669f3b1.slice/crio-fdfab4c102e13ed89a2c21e1f989a6690c64cd70c7ffb57b74bc2d9f3c08afb8 WatchSource:0}: Error finding container fdfab4c102e13ed89a2c21e1f989a6690c64cd70c7ffb57b74bc2d9f3c08afb8: Status 404 returned error can't find the container with id fdfab4c102e13ed89a2c21e1f989a6690c64cd70c7ffb57b74bc2d9f3c08afb8
Sep 08 00:47:21.533774 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.533740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:21.634839 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.634817    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:47:21.772799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.772767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-certs\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.772992 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.772810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-socket\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.772992 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.772887    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-token\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.772992 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.772928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2xhk\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-kube-api-access-r2xhk\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.772992 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.772979    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-credential-socket\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.773207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istiod-ca-cert\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.773207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-envoy\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.773207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773126    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-data\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.773207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:47:21.773207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773163    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-podinfo\") pod \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\" (UID: \"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa\") "
Sep 08 00:47:21.773207 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:47:21.773482 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:47:21.773482 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:47:21.773589 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:47:21.773789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773764    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.773895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773790    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.773895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773804    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.773895 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.773816    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.779156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.777981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-kube-api-access-r2xhk" (OuterVolumeSpecName: "kube-api-access-r2xhk") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "kube-api-access-r2xhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:47:21.779156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.778091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:47:21.779156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.778161    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:47:21.779727 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.779676    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" (UID: "66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:47:21.871298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.871253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k" event={"ID":"27fb7345-49a1-467d-bd7f-6515d669f3b1","Type":"ContainerStarted","Data":"fdfab4c102e13ed89a2c21e1f989a6690c64cd70c7ffb57b74bc2d9f3c08afb8"}
Sep 08 00:47:21.873636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.873608    2578 generic.go:356] "Generic (PLEG): container finished" podID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerID="ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84" exitCode=0
Sep 08 00:47:21.873797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.873777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" event={"ID":"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa","Type":"ContainerDied","Data":"ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84"}
Sep 08 00:47:21.873876 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.873827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6" event={"ID":"66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa","Type":"ContainerDied","Data":"c437d580ccf0f3440a1fa3508502c26b26648417cab2d20a149407d70f802154"}
Sep 08 00:47:21.873876 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.873858    2578 scope.go:117] "RemoveContainer" containerID="ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84"
Sep 08 00:47:21.875351 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.874024    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"
Sep 08 00:47:21.878705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.876011    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.878705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.876041    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2xhk\" (UniqueName: \"kubernetes.io/projected/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-kube-api-access-r2xhk\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.878705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.876056    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.878705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.876070    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.878705 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.876082    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:47:21.897871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.896788    2578 scope.go:117] "RemoveContainer" containerID="51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"
Sep 08 00:47:21.913660 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.913613    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"]
Sep 08 00:47:21.921644 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.920960    2578 scope.go:117] "RemoveContainer" containerID="ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84"
Sep 08 00:47:21.921644 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:47:21.921357    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84\": container with ID starting with ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84 not found: ID does not exist" containerID="ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84"
Sep 08 00:47:21.921644 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.921396    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84"} err="failed to get container status \"ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84\": rpc error: code = NotFound desc = could not find container \"ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84\": container with ID starting with ed4af2a4fd454ffeffa3d37f69d334aeed88248bc428d68f487950247810fb84 not found: ID does not exist"
Sep 08 00:47:21.921644 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.921422    2578 scope.go:117] "RemoveContainer" containerID="51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"
Sep 08 00:47:21.921936 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:47:21.921752    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0\": container with ID starting with 51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0 not found: ID does not exist" containerID="51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"
Sep 08 00:47:21.921936 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.921788    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0"} err="failed to get container status \"51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0\": rpc error: code = NotFound desc = could not find container \"51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0\": container with ID starting with 51283a32fc80a5263dd237a4f9de879f070ff79194c3d3fb9a9922a2e1083bd0 not found: ID does not exist"
Sep 08 00:47:21.924486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:21.924369    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-31f424-openshift-default-7c7f998d5d-49zj6"]
Sep 08 00:47:22.062938 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:22.062906    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" path="/var/lib/kubelet/pods/66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa/volumes"
Sep 08 00:47:22.882730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:22.882668    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k" event={"ID":"27fb7345-49a1-467d-bd7f-6515d669f3b1","Type":"ContainerStarted","Data":"1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc"}
Sep 08 00:47:22.882934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:22.882886    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:22.900778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:22.900731    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k" podStartSLOduration=2.497199165 podStartE2EDuration="2.900716489s" totalImagesPullingTime="403.517324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:47:22.898329088 +0000 UTC m=+865.276702522" watchObservedRunningTime="2026-09-08 00:47:22.900716489 +0000 UTC m=+865.279089922"
Sep 08 00:47:25.467229 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:25.467186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:25.597063 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:25.597030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:25.727225 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:25.727137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:25.825172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:25.825143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:26.358093 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:26.358062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:26.455888 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:26.455857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:26.558881 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:26.558850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:27.891654 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:27.891613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:28.893856 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:28.893828    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:47:33.886283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:33.886239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:33.985701 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:33.985640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:34.541169 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:34.541125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:37.750201 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:37.750167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:37.806574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:37.806538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:40.422867 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.422824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:40.523269 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.523237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:40.628971 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.628935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.874543    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"]
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.875257    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy"
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.875277    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy"
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.875306    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy"
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.875315    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy"
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.875415    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy"
Sep 08 00:47:40.881718 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.879034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.882201 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.882043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f627f164-openshift-default-dockercfg-9w7x5\""
Sep 08 00:47:40.890839 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.890811    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"]
Sep 08 00:47:40.910759 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.910722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:40.966881 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.966858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-token\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.966994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.966892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-certs\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.966994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.966962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4r7b\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-kube-api-access-x4r7b\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.966994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.966986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65f0531-03a0-40cf-9607-1874b58b7ed3-istiod-ca-cert\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.967104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.967043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-data\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.967104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.967068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-podinfo\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.967104 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.967087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-envoy\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.967216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.967112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-socket\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:40.967216 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:40.967187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-credential-socket\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.029740 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.029668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:41.067955 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.067931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4r7b\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-kube-api-access-x4r7b\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.067961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65f0531-03a0-40cf-9607-1874b58b7ed3-istiod-ca-cert\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-data\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-podinfo\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068313 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-envoy\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068313 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-socket\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068418 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-credential-socket\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068418 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-token\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068418 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-certs\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068572 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-data\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-socket\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-credential-socket\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068957 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-certs\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.068957 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.068945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65f0531-03a0-40cf-9607-1874b58b7ed3-istiod-ca-cert\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.070783 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.070763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-podinfo\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.070853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.070826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-envoy\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.082527 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.082480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4r7b\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-kube-api-access-x4r7b\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.083131 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.083056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-token\") pod \"e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") " pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.193631 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.193539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:41.473596 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.473568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"]
Sep 08 00:47:41.474886 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:47:41.474856    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65f0531_03a0_40cf_9607_1874b58b7ed3.slice/crio-89616a14d4b6bd2be67acb0c13a8e8d8334a8dc617939c1ce6f2b86b5e3dbe77 WatchSource:0}: Error finding container 89616a14d4b6bd2be67acb0c13a8e8d8334a8dc617939c1ce6f2b86b5e3dbe77: Status 404 returned error can't find the container with id 89616a14d4b6bd2be67acb0c13a8e8d8334a8dc617939c1ce6f2b86b5e3dbe77
Sep 08 00:47:41.477928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.477888    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:41.478041 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.477995    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:41.478101 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:41.478052    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:42.011096 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:42.011055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" event={"ID":"d65f0531-03a0-40cf-9607-1874b58b7ed3","Type":"ContainerStarted","Data":"e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"}
Sep 08 00:47:42.011271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:42.011130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" event={"ID":"d65f0531-03a0-40cf-9607-1874b58b7ed3","Type":"ContainerStarted","Data":"89616a14d4b6bd2be67acb0c13a8e8d8334a8dc617939c1ce6f2b86b5e3dbe77"}
Sep 08 00:47:42.031764 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:42.031712    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podStartSLOduration=2.031678055 podStartE2EDuration="2.031678055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:47:42.030109588 +0000 UTC m=+884.408483023" watchObservedRunningTime="2026-09-08 00:47:42.031678055 +0000 UTC m=+884.410051487"
Sep 08 00:47:42.194013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:42.193974    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:42.195287 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:42.195261    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:47:42.195346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:42.195317    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:47:43.197643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:43.197612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:43.857625 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:43.857597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:43.963658 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:43.963629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:44.024776 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.024712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" event={"ID":"3261ed65-9f99-407a-b896-3f7c9c543b9f","Type":"ContainerDied","Data":"7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"}
Sep 08 00:47:44.024894 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.024707    2578 generic.go:356] "Generic (PLEG): container finished" podID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerID="7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74" exitCode=0
Sep 08 00:47:44.025151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.025133    2578 scope.go:117] "RemoveContainer" containerID="7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"
Sep 08 00:47:44.025290 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.025271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:44.026179 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.026159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:47:44.026356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.026329    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:44.026425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.026407    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:44.026471 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.026456    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:47:44.664708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:44.664659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:45.037794 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.037706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" event={"ID":"3261ed65-9f99-407a-b896-3f7c9c543b9f","Type":"ContainerStarted","Data":"cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4"}
Sep 08 00:47:45.073240 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.073208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:45.137704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.137651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:45.361151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.361118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:45.361432 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.361408    2578 patch_prober.go:28] interesting pod/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 08 00:47:45.361509 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.361467    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 08 00:47:45.601708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.598266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:45.693760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.693656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:47:45.743001 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.742970    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"]
Sep 08 00:47:45.743552 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.743537    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="66bb5b63-a0ef-4f33-a35f-6a14cbd6deaa" containerName="istio-proxy"
Sep 08 00:47:45.746798 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.746782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:45.749595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.749564    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f627f164\""
Sep 08 00:47:45.749595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.749576    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f627f164-dockercfg-mnjhm\""
Sep 08 00:47:45.755344 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.755321    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"]
Sep 08 00:47:45.830375 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.830335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbczq\" (UniqueName: \"kubernetes.io/projected/7a0861da-7bfd-4151-9a42-15e04bd11fa8-kube-api-access-hbczq\") pod \"payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:45.830656 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.830632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0861da-7bfd-4151-9a42-15e04bd11fa8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:45.932086 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.932054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbczq\" (UniqueName: \"kubernetes.io/projected/7a0861da-7bfd-4151-9a42-15e04bd11fa8-kube-api-access-hbczq\") pod \"payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:45.932239 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.932115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0861da-7bfd-4151-9a42-15e04bd11fa8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:45.932904 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.932884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0861da-7bfd-4151-9a42-15e04bd11fa8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:45.940147 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:45.940126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbczq\" (UniqueName: \"kubernetes.io/projected/7a0861da-7bfd-4151-9a42-15e04bd11fa8-kube-api-access-hbczq\") pod \"payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:46.100352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:46.100320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:46.360581 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:46.360507    2578 patch_prober.go:28] interesting pod/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 08 00:47:46.360581 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:46.360573    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 08 00:47:46.387976 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:47:46.387924    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0861da_7bfd_4151_9a42_15e04bd11fa8.slice/crio-dc996ddf549a92f93399e6479a1f5a5c03442ccd1048ed93361df0bf5de9be68 WatchSource:0}: Error finding container dc996ddf549a92f93399e6479a1f5a5c03442ccd1048ed93361df0bf5de9be68: Status 404 returned error can't find the container with id dc996ddf549a92f93399e6479a1f5a5c03442ccd1048ed93361df0bf5de9be68
Sep 08 00:47:46.397932 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:46.397893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"]
Sep 08 00:47:47.051742 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:47.051669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz" event={"ID":"7a0861da-7bfd-4151-9a42-15e04bd11fa8","Type":"ContainerStarted","Data":"c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27"}
Sep 08 00:47:47.051742 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:47.051732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:47:47.051742 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:47.051750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz" event={"ID":"7a0861da-7bfd-4151-9a42-15e04bd11fa8","Type":"ContainerStarted","Data":"dc996ddf549a92f93399e6479a1f5a5c03442ccd1048ed93361df0bf5de9be68"}
Sep 08 00:47:47.068477 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:47.068425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz" podStartSLOduration=2.068405983 podStartE2EDuration="2.068405983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:47:47.06759562 +0000 UTC m=+889.445969054" watchObservedRunningTime="2026-09-08 00:47:47.068405983 +0000 UTC m=+889.446779416"
Sep 08 00:47:47.361088 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:47.360996    2578 patch_prober.go:28] interesting pod/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 08 00:47:47.361088 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:47.361059    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 08 00:47:48.360594 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:48.360558    2578 patch_prober.go:28] interesting pod/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 08 00:47:48.360996 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:48.360610    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 08 00:47:48.849780 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:48.849746    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:49.360169 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:49.360135    2578 patch_prober.go:28] interesting pod/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 08 00:47:49.360329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:49.360194    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 08 00:47:50.364013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:50.363979    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:50.364930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:50.364907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:47:58.067559 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:47:58.067524    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:48:03.155339 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:03.155254    2578 generic.go:356] "Generic (PLEG): container finished" podID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerID="e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243" exitCode=0
Sep 08 00:48:03.155339 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:03.155319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" event={"ID":"d65f0531-03a0-40cf-9607-1874b58b7ed3","Type":"ContainerDied","Data":"e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"}
Sep 08 00:48:03.155761 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:03.155725    2578 scope.go:117] "RemoveContainer" containerID="e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"
Sep 08 00:48:03.158329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:03.157531    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:48:03.158329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:03.157803    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:48:03.158329 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:03.157950    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:48:04.163738 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:04.163677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" event={"ID":"d65f0531-03a0-40cf-9607-1874b58b7ed3","Type":"ContainerStarted","Data":"9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d"}
Sep 08 00:48:04.194181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:04.194149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:48:04.194346 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:04.194301    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:48:04.194395 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:04.194354    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:48:05.194328 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:05.194274    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:48:05.194969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:05.194936    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:48:06.194375 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:06.194340    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:48:06.194939 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:06.194908    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:48:06.795326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:06.795292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:07.194928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:07.194826    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:48:07.194928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:07.194893    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:48:08.194667 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:08.194627    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:48:08.194927 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:08.194714    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:48:08.744738 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:08.744675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:09.204040 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:09.204006    2578 patch_prober.go:28] interesting pod/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:48:09.204321 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:09.204291    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 08 00:48:09.356469 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:09.356435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:09.451428 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:09.451397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:09.754792 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:09.754754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:10.212028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:10.211998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:48:10.212540 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:10.212503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:48:10.213350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:10.213331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:48:15.603338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:15.603305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:15.704729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:15.704671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:16.865098 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:16.865067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:26.517200 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.517161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:26.546182 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.546148    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"]
Sep 08 00:48:26.546485 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.546422    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz" podUID="7a0861da-7bfd-4151-9a42-15e04bd11fa8" containerName="payload-pre-processing" containerID="cri-o://c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27" gracePeriod=30
Sep 08 00:48:26.614727 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.614673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:26.710043 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.710004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:26.766966 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.766921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:26.791468 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.791449    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:48:26.892465 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.892073    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbczq\" (UniqueName: \"kubernetes.io/projected/7a0861da-7bfd-4151-9a42-15e04bd11fa8-kube-api-access-hbczq\") pod \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") "
Sep 08 00:48:26.892465 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.892265    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0861da-7bfd-4151-9a42-15e04bd11fa8-plugins-config-volume\") pod \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\" (UID: \"7a0861da-7bfd-4151-9a42-15e04bd11fa8\") "
Sep 08 00:48:26.895119 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.893292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a0861da-7bfd-4151-9a42-15e04bd11fa8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a0861da-7bfd-4151-9a42-15e04bd11fa8" (UID: "7a0861da-7bfd-4151-9a42-15e04bd11fa8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:48:26.898627 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.898593    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0861da-7bfd-4151-9a42-15e04bd11fa8-kube-api-access-hbczq" (OuterVolumeSpecName: "kube-api-access-hbczq") pod "7a0861da-7bfd-4151-9a42-15e04bd11fa8" (UID: "7a0861da-7bfd-4151-9a42-15e04bd11fa8"). InnerVolumeSpecName "kube-api-access-hbczq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:48:26.993546 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.993515    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a0861da-7bfd-4151-9a42-15e04bd11fa8-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:26.993546 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:26.993542    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbczq\" (UniqueName: \"kubernetes.io/projected/7a0861da-7bfd-4151-9a42-15e04bd11fa8-kube-api-access-hbczq\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:27.030327 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.030239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:27.302315 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.302278    2578 generic.go:356] "Generic (PLEG): container finished" podID="7a0861da-7bfd-4151-9a42-15e04bd11fa8" containerID="c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27" exitCode=0
Sep 08 00:48:27.302484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.302340    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"
Sep 08 00:48:27.302484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.302367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz" event={"ID":"7a0861da-7bfd-4151-9a42-15e04bd11fa8","Type":"ContainerDied","Data":"c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27"}
Sep 08 00:48:27.302484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.302425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz" event={"ID":"7a0861da-7bfd-4151-9a42-15e04bd11fa8","Type":"ContainerDied","Data":"dc996ddf549a92f93399e6479a1f5a5c03442ccd1048ed93361df0bf5de9be68"}
Sep 08 00:48:27.302484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.302451    2578 scope.go:117] "RemoveContainer" containerID="c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27"
Sep 08 00:48:27.311991 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.311976    2578 scope.go:117] "RemoveContainer" containerID="c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27"
Sep 08 00:48:27.314991 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:48:27.312390    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27\": container with ID starting with c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27 not found: ID does not exist" containerID="c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27"
Sep 08 00:48:27.314991 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.312427    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27"} err="failed to get container status \"c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27\": rpc error: code = NotFound desc = could not find container \"c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27\": container with ID starting with c890077fdbe549b6429f9ec8648abf65e360afc2f52c323b835c5bf6ac5cfc27 not found: ID does not exist"
Sep 08 00:48:27.336991 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.336964    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"]
Sep 08 00:48:27.345072 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:27.345049    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f627f164-5458d84fd-27wvz"]
Sep 08 00:48:28.058155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:28.058123    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0861da-7bfd-4151-9a42-15e04bd11fa8" path="/var/lib/kubelet/pods/7a0861da-7bfd-4151-9a42-15e04bd11fa8/volumes"
Sep 08 00:48:33.186578 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:33.186540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:33.399379 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:33.399341    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"]
Sep 08 00:48:33.399630 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:33.399604    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy" containerID="cri-o://9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d" gracePeriod=30
Sep 08 00:48:34.456163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:34.456122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:38.664136 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.664113    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:48:38.700368 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700298    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-certs\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700399    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-data\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-token\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700548 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700501    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-credential-socket\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700548 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-envoy\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700557    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-podinfo\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700613 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4r7b\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-kube-api-access-x4r7b\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700694 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700527    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:48:38.700694 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65f0531-03a0-40cf-9607-1874b58b7ed3-istiod-ca-cert\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700694 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700636    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-data" (OuterVolumeSpecName: "istio-data") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:48:38.700852 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-socket\") pod \"d65f0531-03a0-40cf-9607-1874b58b7ed3\" (UID: \"d65f0531-03a0-40cf-9607-1874b58b7ed3\") "
Sep 08 00:48:38.700852 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.700780    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:48:38.701167 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.701073    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65f0531-03a0-40cf-9607-1874b58b7ed3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:48:38.701278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.701119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:48:38.701278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.701130    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.701278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.701205    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.701278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.701222    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.702659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.702637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:48:38.703017 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.702991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-kube-api-access-x4r7b" (OuterVolumeSpecName: "kube-api-access-x4r7b") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "kube-api-access-x4r7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:48:38.703129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.703113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-token" (OuterVolumeSpecName: "istio-token") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:48:38.703187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.703159    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d65f0531-03a0-40cf-9607-1874b58b7ed3" (UID: "d65f0531-03a0-40cf-9607-1874b58b7ed3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:48:38.801725 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.801702    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d65f0531-03a0-40cf-9607-1874b58b7ed3-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.801725 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.801724    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.801853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.801733    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.801853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.801742    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.801853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.801751    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d65f0531-03a0-40cf-9607-1874b58b7ed3-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:38.801853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:38.801759    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4r7b\" (UniqueName: \"kubernetes.io/projected/d65f0531-03a0-40cf-9607-1874b58b7ed3-kube-api-access-x4r7b\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:39.373299 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.373269    2578 generic.go:356] "Generic (PLEG): container finished" podID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerID="9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d" exitCode=0
Sep 08 00:48:39.373478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.373311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"
Sep 08 00:48:39.373478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.373354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" event={"ID":"d65f0531-03a0-40cf-9607-1874b58b7ed3","Type":"ContainerDied","Data":"9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d"}
Sep 08 00:48:39.373478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.373417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4" event={"ID":"d65f0531-03a0-40cf-9607-1874b58b7ed3","Type":"ContainerDied","Data":"89616a14d4b6bd2be67acb0c13a8e8d8334a8dc617939c1ce6f2b86b5e3dbe77"}
Sep 08 00:48:39.373478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.373447    2578 scope.go:117] "RemoveContainer" containerID="9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d"
Sep 08 00:48:39.385372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.385355    2578 scope.go:117] "RemoveContainer" containerID="e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"
Sep 08 00:48:39.393924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.393906    2578 scope.go:117] "RemoveContainer" containerID="9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d"
Sep 08 00:48:39.394198 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:48:39.394178    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d\": container with ID starting with 9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d not found: ID does not exist" containerID="9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d"
Sep 08 00:48:39.394286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.394202    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d"} err="failed to get container status \"9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d\": rpc error: code = NotFound desc = could not find container \"9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d\": container with ID starting with 9b927c781346dec5ae64ff92c3b53ed4714e2e3f52331634f3d1114f344c5a6d not found: ID does not exist"
Sep 08 00:48:39.394286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.394219    2578 scope.go:117] "RemoveContainer" containerID="e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"
Sep 08 00:48:39.394465 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:48:39.394450    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243\": container with ID starting with e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243 not found: ID does not exist" containerID="e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"
Sep 08 00:48:39.394510 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.394468    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243"} err="failed to get container status \"e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243\": rpc error: code = NotFound desc = could not find container \"e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243\": container with ID starting with e910de1f642f9cd5d7c8fc4841cd7c261714991b289daaf6f5ff6bbc0da7b243 not found: ID does not exist"
Sep 08 00:48:39.398606 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.398583    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"]
Sep 08 00:48:39.401726 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.401705    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f627f164-openshift-default-66d7f74588-c7jp4"]
Sep 08 00:48:39.776460 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.776379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:39.846326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.846290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:39.930477 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:39.930440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:40.057730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:40.057699    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" path="/var/lib/kubelet/pods/d65f0531-03a0-40cf-9607-1874b58b7ed3/volumes"
Sep 08 00:48:40.090331 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:40.090295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:41.902571 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:41.902532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:42.083137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:42.083103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:46.191303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:46.191258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:46.291769 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:46.291739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:47.060475 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.060434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:47.314675 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.314600    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"]
Sep 08 00:48:47.315091 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315076    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy"
Sep 08 00:48:47.315157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315093    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy"
Sep 08 00:48:47.315157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315105    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0861da-7bfd-4151-9a42-15e04bd11fa8" containerName="payload-pre-processing"
Sep 08 00:48:47.315157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315111    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0861da-7bfd-4151-9a42-15e04bd11fa8" containerName="payload-pre-processing"
Sep 08 00:48:47.315157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315128    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy"
Sep 08 00:48:47.315157 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315136    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy"
Sep 08 00:48:47.315338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315209    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy"
Sep 08 00:48:47.315338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315221    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0861da-7bfd-4151-9a42-15e04bd11fa8" containerName="payload-pre-processing"
Sep 08 00:48:47.315338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.315230    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65f0531-03a0-40cf-9607-1874b58b7ed3" containerName="istio-proxy"
Sep 08 00:48:47.317415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.317399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.319973 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.319953    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-c99af4-openshift-default-dockercfg-vhp7f\""
Sep 08 00:48:47.330464 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.330440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"]
Sep 08 00:48:47.341249 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.341223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:47.389778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.389739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bh6k\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-kube-api-access-7bh6k\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.389913 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.389803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-certs\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.389913 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.389869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-envoy\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.390033 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.389955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-data\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.390033 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.390001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-credential-socket\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.390146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.390049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-socket\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.390146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.390080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-podinfo\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.390146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.390105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-token\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.390245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.390189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b2daee3-e01e-4d6c-842e-400b65d90649-istiod-ca-cert\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.490923 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.490889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bh6k\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-kube-api-access-7bh6k\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491089 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.490935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-certs\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491089 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.490969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-envoy\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491089 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-data\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491089 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-credential-socket\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-socket\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-podinfo\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-token\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491350 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b2daee3-e01e-4d6c-842e-400b65d90649-istiod-ca-cert\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491581 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-certs\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.491741 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.491714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-data\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.492053 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.492027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b2daee3-e01e-4d6c-842e-400b65d90649-istiod-ca-cert\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.492162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.492081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-credential-socket\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.492162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.492132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-socket\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.493761 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.493741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-podinfo\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.493856 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.493813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-envoy\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.499143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.499115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-token\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.499368 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.499350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bh6k\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-kube-api-access-7bh6k\") pod \"e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") " pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.628527 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.628463    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:47.838909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.838854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:47.908370 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:48:47.908340    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2daee3_e01e_4d6c_842e_400b65d90649.slice/crio-bd499ec8ab17651f572c875a028a25dda4d68a70c40eaded87eb3f1a98ab52df WatchSource:0}: Error finding container bd499ec8ab17651f572c875a028a25dda4d68a70c40eaded87eb3f1a98ab52df: Status 404 returned error can't find the container with id bd499ec8ab17651f572c875a028a25dda4d68a70c40eaded87eb3f1a98ab52df
Sep 08 00:48:47.908735 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.908669    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"]
Sep 08 00:48:47.911367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.911331    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:48:47.911476 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.911406    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:48:47.911476 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:47.911435    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:48:48.436253 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:48.436213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" event={"ID":"1b2daee3-e01e-4d6c-842e-400b65d90649","Type":"ContainerStarted","Data":"a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"}
Sep 08 00:48:48.436738 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:48.436272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" event={"ID":"1b2daee3-e01e-4d6c-842e-400b65d90649","Type":"ContainerStarted","Data":"bd499ec8ab17651f572c875a028a25dda4d68a70c40eaded87eb3f1a98ab52df"}
Sep 08 00:48:48.457292 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:48.457251    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podStartSLOduration=1.457237127 podStartE2EDuration="1.457237127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:48:48.4553182 +0000 UTC m=+950.833691634" watchObservedRunningTime="2026-09-08 00:48:48.457237127 +0000 UTC m=+950.835610560"
Sep 08 00:48:48.519069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:48.519037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:48.628704 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:48.628657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:48.633288 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:48.633265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:49.443129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:49.443094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:49.444163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:49.444143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:48:50.322155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:50.322116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:50.414055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:50.414016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:51.643768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.643723    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"]
Sep 08 00:48:51.647122 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.647084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.649731 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.649706    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-c99af4-serving-cert\""
Sep 08 00:48:51.656545 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.656515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"]
Sep 08 00:48:51.677674 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.677636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:51.731874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.731850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.731994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.731920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7sp\" (UniqueName: \"kubernetes.io/projected/a1b847d3-9f33-400e-971e-aef8bb394a51-kube-api-access-4w7sp\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.731994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.731968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b847d3-9f33-400e-971e-aef8bb394a51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.732087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.732013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.778317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.778271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:51.833433 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.833397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.833595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.833503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7sp\" (UniqueName: \"kubernetes.io/projected/a1b847d3-9f33-400e-971e-aef8bb394a51-kube-api-access-4w7sp\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.833595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.833564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b847d3-9f33-400e-971e-aef8bb394a51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.833752 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.833623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.834211 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.834189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b847d3-9f33-400e-971e-aef8bb394a51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.835866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.835844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.835985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.835966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.841752 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.841734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7sp\" (UniqueName: \"kubernetes.io/projected/a1b847d3-9f33-400e-971e-aef8bb394a51-kube-api-access-4w7sp\") pod \"maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:51.878764 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.878735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:51.961050 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:51.960996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:52.149924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.149887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:52.230486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.230457    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"]
Sep 08 00:48:52.231648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.231609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:52.231938 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:48:52.231917    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b847d3_9f33_400e_971e_aef8bb394a51.slice/crio-6822e01e6410c0bd75c104a652a7ef1985948c8870b2849b94290176743f7c60 WatchSource:0}: Error finding container 6822e01e6410c0bd75c104a652a7ef1985948c8870b2849b94290176743f7c60: Status 404 returned error can't find the container with id 6822e01e6410c0bd75c104a652a7ef1985948c8870b2849b94290176743f7c60
Sep 08 00:48:52.233708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.233667    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:48:52.330928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.330902    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"]
Sep 08 00:48:52.334228 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.334212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.337212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.337191    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-c99af4\""
Sep 08 00:48:52.337444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.337430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-c99af4-dockercfg-7ngrl\""
Sep 08 00:48:52.344117 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.344094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"]
Sep 08 00:48:52.441102 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.441067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.441283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.441130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbjcc\" (UniqueName: \"kubernetes.io/projected/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-kube-api-access-fbjcc\") pod \"payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.451546 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.451231    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"]
Sep 08 00:48:52.451546 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.451451    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k" podUID="27fb7345-49a1-467d-bd7f-6515d669f3b1" containerName="maas-api" containerID="cri-o://1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc" gracePeriod=30
Sep 08 00:48:52.465194 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.465167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv" event={"ID":"a1b847d3-9f33-400e-971e-aef8bb394a51","Type":"ContainerStarted","Data":"6822e01e6410c0bd75c104a652a7ef1985948c8870b2849b94290176743f7c60"}
Sep 08 00:48:52.479280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.479197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:52.542190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.542152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbjcc\" (UniqueName: \"kubernetes.io/projected/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-kube-api-access-fbjcc\") pod \"payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.542413 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.542391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.543282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.543258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.552202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.552175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbjcc\" (UniqueName: \"kubernetes.io/projected/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-kube-api-access-fbjcc\") pod \"payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.579967 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.579935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:52.646013 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.645991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:52.682643 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.682572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:52.716636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.716546    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:48:52.780172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.780074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:52.849728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.847638    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-metrics-certs\") pod \"27fb7345-49a1-467d-bd7f-6515d669f3b1\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") "
Sep 08 00:48:52.849728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.847721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h72mb\" (UniqueName: \"kubernetes.io/projected/27fb7345-49a1-467d-bd7f-6515d669f3b1-kube-api-access-h72mb\") pod \"27fb7345-49a1-467d-bd7f-6515d669f3b1\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") "
Sep 08 00:48:52.849728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.847912    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27fb7345-49a1-467d-bd7f-6515d669f3b1-openshift-service-ca\") pod \"27fb7345-49a1-467d-bd7f-6515d669f3b1\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") "
Sep 08 00:48:52.849728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.847969    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-maas-api-tls\") pod \"27fb7345-49a1-467d-bd7f-6515d669f3b1\" (UID: \"27fb7345-49a1-467d-bd7f-6515d669f3b1\") "
Sep 08 00:48:52.849728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.848464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27fb7345-49a1-467d-bd7f-6515d669f3b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27fb7345-49a1-467d-bd7f-6515d669f3b1" (UID: "27fb7345-49a1-467d-bd7f-6515d669f3b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:48:52.851179 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.850369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27fb7345-49a1-467d-bd7f-6515d669f3b1-kube-api-access-h72mb" (OuterVolumeSpecName: "kube-api-access-h72mb") pod "27fb7345-49a1-467d-bd7f-6515d669f3b1" (UID: "27fb7345-49a1-467d-bd7f-6515d669f3b1"). InnerVolumeSpecName "kube-api-access-h72mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:48:52.851179 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.851147    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27fb7345-49a1-467d-bd7f-6515d669f3b1" (UID: "27fb7345-49a1-467d-bd7f-6515d669f3b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:48:52.853003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.852034    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "27fb7345-49a1-467d-bd7f-6515d669f3b1" (UID: "27fb7345-49a1-467d-bd7f-6515d669f3b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:48:52.928524 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.928495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"]
Sep 08 00:48:52.929595 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:48:52.929569    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde07df94_e4e8_49e7_9ed3_b9bda5778e0b.slice/crio-b6e497aa9b402ea6f64638ef9d6c02989b73e5c4aaafd82ce46c0551c2b09759 WatchSource:0}: Error finding container b6e497aa9b402ea6f64638ef9d6c02989b73e5c4aaafd82ce46c0551c2b09759: Status 404 returned error can't find the container with id b6e497aa9b402ea6f64638ef9d6c02989b73e5c4aaafd82ce46c0551c2b09759
Sep 08 00:48:52.949678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.949631    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-metrics-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:52.949799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.949694    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h72mb\" (UniqueName: \"kubernetes.io/projected/27fb7345-49a1-467d-bd7f-6515d669f3b1-kube-api-access-h72mb\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:52.949799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.949710    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27fb7345-49a1-467d-bd7f-6515d669f3b1-openshift-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:52.949799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:52.949722    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27fb7345-49a1-467d-bd7f-6515d669f3b1-maas-api-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:48:53.033964 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.033873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:53.472765 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.472734    2578 generic.go:356] "Generic (PLEG): container finished" podID="27fb7345-49a1-467d-bd7f-6515d669f3b1" containerID="1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc" exitCode=0
Sep 08 00:48:53.472951 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.472774    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"
Sep 08 00:48:53.472951 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.472818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k" event={"ID":"27fb7345-49a1-467d-bd7f-6515d669f3b1","Type":"ContainerDied","Data":"1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc"}
Sep 08 00:48:53.472951 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.472874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k" event={"ID":"27fb7345-49a1-467d-bd7f-6515d669f3b1","Type":"ContainerDied","Data":"fdfab4c102e13ed89a2c21e1f989a6690c64cd70c7ffb57b74bc2d9f3c08afb8"}
Sep 08 00:48:53.472951 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.472903    2578 scope.go:117] "RemoveContainer" containerID="1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc"
Sep 08 00:48:53.474809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.474783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv" event={"ID":"a1b847d3-9f33-400e-971e-aef8bb394a51","Type":"ContainerStarted","Data":"5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487"}
Sep 08 00:48:53.475471 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.475356    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:48:53.477294 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.477273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff" event={"ID":"de07df94-e4e8-49e7-9ed3-b9bda5778e0b","Type":"ContainerStarted","Data":"807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6"}
Sep 08 00:48:53.477404 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.477317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff" event={"ID":"de07df94-e4e8-49e7-9ed3-b9bda5778e0b","Type":"ContainerStarted","Data":"b6e497aa9b402ea6f64638ef9d6c02989b73e5c4aaafd82ce46c0551c2b09759"}
Sep 08 00:48:53.477765 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.477641    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:48:53.483811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.483796    2578 scope.go:117] "RemoveContainer" containerID="1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc"
Sep 08 00:48:53.484097 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:48:53.484069    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc\": container with ID starting with 1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc not found: ID does not exist" containerID="1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc"
Sep 08 00:48:53.484194 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.484106    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc"} err="failed to get container status \"1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc\": rpc error: code = NotFound desc = could not find container \"1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc\": container with ID starting with 1ab95c25878d05f92ac6f8e31b2d45a4e717807aa512bec146d7f0eb53b4a4dc not found: ID does not exist"
Sep 08 00:48:53.495954 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.495917    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv" podStartSLOduration=2.138650353 podStartE2EDuration="2.495905904s" totalImagesPullingTime="357.255551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:48:53.495350977 +0000 UTC m=+955.873724410" watchObservedRunningTime="2026-09-08 00:48:53.495905904 +0000 UTC m=+955.874279337"
Sep 08 00:48:53.511022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.510986    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff" podStartSLOduration=1.510974644 podStartE2EDuration="1.510974644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:48:53.510478138 +0000 UTC m=+955.888851572" watchObservedRunningTime="2026-09-08 00:48:53.510974644 +0000 UTC m=+955.889348076"
Sep 08 00:48:53.524356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.524334    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"]
Sep 08 00:48:53.527858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:53.527829    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-e4902f-5c8cf695f7-s7p5k"]
Sep 08 00:48:54.058719 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:54.058673    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27fb7345-49a1-467d-bd7f-6515d669f3b1" path="/var/lib/kubelet/pods/27fb7345-49a1-467d-bd7f-6515d669f3b1/volumes"
Sep 08 00:48:59.003461 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.003423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:59.067377 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.067341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:59.231409 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.231374    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"]
Sep 08 00:48:59.231671 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.231620    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy" containerID="cri-o://cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4" gracePeriod=30
Sep 08 00:48:59.252286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.252257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:59.665415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.665378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:48:59.957669 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:48:59.957484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:00.505837 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:00.505805    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:49:00.627278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:00.627244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:01.460533 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:01.460496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:01.563826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:01.563796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:01.662642 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:01.662612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:04.499729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.498826    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:49:04.543151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.543121    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:49:04.565575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.565541    2578 generic.go:356] "Generic (PLEG): container finished" podID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerID="cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4" exitCode=0
Sep 08 00:49:04.565974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.565766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" event={"ID":"3261ed65-9f99-407a-b896-3f7c9c543b9f","Type":"ContainerDied","Data":"cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4"}
Sep 08 00:49:04.565974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.565795    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"
Sep 08 00:49:04.565974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.565822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j" event={"ID":"3261ed65-9f99-407a-b896-3f7c9c543b9f","Type":"ContainerDied","Data":"776ac038d98aebee368768c15eef79aecda16df0c6e98ac4f7ed0b698c4beece"}
Sep 08 00:49:04.565974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.565849    2578 scope.go:117] "RemoveContainer" containerID="cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4"
Sep 08 00:49:04.579190 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.579130    2578 scope.go:117] "RemoveContainer" containerID="7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"
Sep 08 00:49:04.591912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.591897    2578 scope.go:117] "RemoveContainer" containerID="cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4"
Sep 08 00:49:04.592293 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:49:04.592259    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4\": container with ID starting with cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4 not found: ID does not exist" containerID="cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4"
Sep 08 00:49:04.592389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.592297    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4"} err="failed to get container status \"cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4\": rpc error: code = NotFound desc = could not find container \"cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4\": container with ID starting with cf839c88e05117becad39cf10f14a4d7f4e4821d49a7f9dad13938024692e5b4 not found: ID does not exist"
Sep 08 00:49:04.592389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.592324    2578 scope.go:117] "RemoveContainer" containerID="7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"
Sep 08 00:49:04.592678 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:49:04.592654    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74\": container with ID starting with 7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74 not found: ID does not exist" containerID="7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"
Sep 08 00:49:04.592786 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.592701    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74"} err="failed to get container status \"7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74\": rpc error: code = NotFound desc = could not find container \"7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74\": container with ID starting with 7e45345801b9f029729fa95adaec26d8049c1ffb1a5c5f0df0ff6734b5ba1f74 not found: ID does not exist"
Sep 08 00:49:04.692387 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692359    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-envoy\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692538 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692409    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-credential-socket\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692538 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-podinfo\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692538 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-certs\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692732 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-socket\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692732 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692710    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3261ed65-9f99-407a-b896-3f7c9c543b9f-istiod-ca-cert\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692772    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-data\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:49:04.692842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:49:04.692994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2fdb\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-kube-api-access-r2fdb\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.692994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:49:04.692994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.692916    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-token\") pod \"3261ed65-9f99-407a-b896-3f7c9c543b9f\" (UID: \"3261ed65-9f99-407a-b896-3f7c9c543b9f\") "
Sep 08 00:49:04.693130 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:49:04.693130 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693055    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3261ed65-9f99-407a-b896-3f7c9c543b9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:49:04.693401 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693374    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.693401 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693401    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.693583 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693417    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.693583 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693432    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3261ed65-9f99-407a-b896-3f7c9c543b9f-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.693583 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.693445    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.694830 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.694800    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-kube-api-access-r2fdb" (OuterVolumeSpecName: "kube-api-access-r2fdb") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "kube-api-access-r2fdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:49:04.694945 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.694842    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:49:04.695336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.695311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:49:04.695336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.695320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3261ed65-9f99-407a-b896-3f7c9c543b9f" (UID: "3261ed65-9f99-407a-b896-3f7c9c543b9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:49:04.795029 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.795007    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.795029 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.795029    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2fdb\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-kube-api-access-r2fdb\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.795163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.795039    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.795163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.795047    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3261ed65-9f99-407a-b896-3f7c9c543b9f-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:04.900888 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.900858    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"]
Sep 08 00:49:04.908695 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:04.908665    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-e4902f-openshift-default-6646649d84-n6z8j"]
Sep 08 00:49:06.057708 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:06.057658    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" path="/var/lib/kubelet/pods/3261ed65-9f99-407a-b896-3f7c9c543b9f/volumes"
Sep 08 00:49:08.591569 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:08.591532    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerID="a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc" exitCode=0
Sep 08 00:49:08.592042 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:08.591614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" event={"ID":"1b2daee3-e01e-4d6c-842e-400b65d90649","Type":"ContainerDied","Data":"a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"}
Sep 08 00:49:08.592042 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:08.592006    2578 scope.go:117] "RemoveContainer" containerID="a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"
Sep 08 00:49:08.593114 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:08.593080    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:49:08.593233 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:08.593166    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:49:08.593303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:08.593247    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:49:09.602909 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:09.602868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" event={"ID":"1b2daee3-e01e-4d6c-842e-400b65d90649","Type":"ContainerStarted","Data":"2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20"}
Sep 08 00:49:09.628674 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:09.628648    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:49:09.628848 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:09.628827    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:49:09.628893 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:09.628880    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 00:49:10.628864 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:10.628828    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:49:10.629220 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:10.628884    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 00:49:11.629634 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:11.629601    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:49:11.630004 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:11.629653    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 00:49:12.629066 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:12.629028    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:49:12.629241 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:12.629090    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 00:49:13.629799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:13.629759    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:49:13.630284 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:13.629829    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 00:49:14.629589 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:14.629549    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:49:14.629799 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:14.629626    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 08 00:49:15.192866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:15.192826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:15.499120 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:15.499034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:15.633129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:15.633095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:49:15.633503 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:15.633479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:49:15.634391 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:15.634368    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:49:15.794760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:15.794723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:16.271539 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:16.271445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:17.434474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:17.434440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:17.491620 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:17.491579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:19.221580 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:19.221541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:19.314645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:19.314598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:20.359811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.359772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:20.426987 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.426961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:20.527237 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.527200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:20.849860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.849824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:20.916729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.916671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:20.953044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953018    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"]
Sep 08 00:49:20.953461 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953447    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy"
Sep 08 00:49:20.953504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953463    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy"
Sep 08 00:49:20.953504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953477    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy"
Sep 08 00:49:20.953504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953483    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy"
Sep 08 00:49:20.953504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953500    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27fb7345-49a1-467d-bd7f-6515d669f3b1" containerName="maas-api"
Sep 08 00:49:20.953504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953505    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27fb7345-49a1-467d-bd7f-6515d669f3b1" containerName="maas-api"
Sep 08 00:49:20.953743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953592    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27fb7345-49a1-467d-bd7f-6515d669f3b1" containerName="maas-api"
Sep 08 00:49:20.953743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953601    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy"
Sep 08 00:49:20.953743 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.953609    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3261ed65-9f99-407a-b896-3f7c9c543b9f" containerName="istio-proxy"
Sep 08 00:49:20.956253 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.956236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:20.958615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.958594    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f04ef7\""
Sep 08 00:49:20.958615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.958611    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f04ef7-dockercfg-4jv9q\""
Sep 08 00:49:20.967410 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.967388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"]
Sep 08 00:49:20.986837 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.986817    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"]
Sep 08 00:49:20.989253 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.989237    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:20.999897 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:20.999878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"]
Sep 08 00:49:21.060402 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.060227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b62b3b-291b-4952-868d-cc8fe4a49415-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.060402 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.060276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnd8j\" (UniqueName: \"kubernetes.io/projected/00b62b3b-291b-4952-868d-cc8fe4a49415-kube-api-access-qnd8j\") pod \"payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.060730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.060422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dph\" (UniqueName: \"kubernetes.io/projected/53a1d003-0554-4a70-b593-db9433018f2e-kube-api-access-l8dph\") pod \"payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.060730 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.060486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a1d003-0554-4a70-b593-db9433018f2e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.161245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.161142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dph\" (UniqueName: \"kubernetes.io/projected/53a1d003-0554-4a70-b593-db9433018f2e-kube-api-access-l8dph\") pod \"payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.161245 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.161223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a1d003-0554-4a70-b593-db9433018f2e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.161477 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.161288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b62b3b-291b-4952-868d-cc8fe4a49415-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.161477 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.161318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnd8j\" (UniqueName: \"kubernetes.io/projected/00b62b3b-291b-4952-868d-cc8fe4a49415-kube-api-access-qnd8j\") pod \"payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.162002 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.161982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b62b3b-291b-4952-868d-cc8fe4a49415-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.162057 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.161983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a1d003-0554-4a70-b593-db9433018f2e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.169107 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.169085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnd8j\" (UniqueName: \"kubernetes.io/projected/00b62b3b-291b-4952-868d-cc8fe4a49415-kube-api-access-qnd8j\") pod \"payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.169208 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.169088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dph\" (UniqueName: \"kubernetes.io/projected/53a1d003-0554-4a70-b593-db9433018f2e-kube-api-access-l8dph\") pod \"payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.264203 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.264174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:21.268101 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.268080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.301465 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.301439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.548985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.548959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"]
Sep 08 00:49:21.549798 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:49:21.549773    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b62b3b_291b_4952_868d_cc8fe4a49415.slice/crio-03f6a594513c7673c360f10d0c4a6f1ca0a0f6784a6e341efbf2ff00361f6d9d WatchSource:0}: Error finding container 03f6a594513c7673c360f10d0c4a6f1ca0a0f6784a6e341efbf2ff00361f6d9d: Status 404 returned error can't find the container with id 03f6a594513c7673c360f10d0c4a6f1ca0a0f6784a6e341efbf2ff00361f6d9d
Sep 08 00:49:21.596541 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.596518    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"]
Sep 08 00:49:21.597778 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:49:21.597735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a1d003_0554_4a70_b593_db9433018f2e.slice/crio-f66e9755cd8e7a4fc2e2c97a6b1292e9552f2b10c3a3fa853d71cadc94178ab7 WatchSource:0}: Error finding container f66e9755cd8e7a4fc2e2c97a6b1292e9552f2b10c3a3fa853d71cadc94178ab7: Status 404 returned error can't find the container with id f66e9755cd8e7a4fc2e2c97a6b1292e9552f2b10c3a3fa853d71cadc94178ab7
Sep 08 00:49:21.673103 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.673071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7" event={"ID":"53a1d003-0554-4a70-b593-db9433018f2e","Type":"ContainerStarted","Data":"685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df"}
Sep 08 00:49:21.673212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.673145    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:21.673212 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.673175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7" event={"ID":"53a1d003-0554-4a70-b593-db9433018f2e","Type":"ContainerStarted","Data":"f66e9755cd8e7a4fc2e2c97a6b1292e9552f2b10c3a3fa853d71cadc94178ab7"}
Sep 08 00:49:21.675327 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.675282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf" event={"ID":"00b62b3b-291b-4952-868d-cc8fe4a49415","Type":"ContainerStarted","Data":"66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552"}
Sep 08 00:49:21.675453 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.675336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf" event={"ID":"00b62b3b-291b-4952-868d-cc8fe4a49415","Type":"ContainerStarted","Data":"03f6a594513c7673c360f10d0c4a6f1ca0a0f6784a6e341efbf2ff00361f6d9d"}
Sep 08 00:49:21.675811 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.675786    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:21.688760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.688664    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7" podStartSLOduration=1.688644249 podStartE2EDuration="1.688644249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:49:21.688251136 +0000 UTC m=+984.066624580" watchObservedRunningTime="2026-09-08 00:49:21.688644249 +0000 UTC m=+984.067017739"
Sep 08 00:49:21.707998 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:21.707961    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf" podStartSLOduration=1.707943427 podStartE2EDuration="1.707943427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:49:21.704561592 +0000 UTC m=+984.082935040" watchObservedRunningTime="2026-09-08 00:49:21.707943427 +0000 UTC m=+984.086316863"
Sep 08 00:49:22.163586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:22.163552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:28.624861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:28.624828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:32.683990 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:32.683953    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:49:33.690142 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:33.690099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:49:35.959512 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:35.959479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:40.854084 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:40.854051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:40.967447 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:40.967410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:41.167831 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:41.167735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:41.269382 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:41.269348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:43.539537 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:43.539504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:43.801567 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:43.801532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:44.038629 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:44.038593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:46.282396 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:46.282357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:46.383388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:46.383348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:53.849075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:53.849037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:54.404936 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.404901    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"]
Sep 08 00:49:54.433990 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.433956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:54.467646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.467615    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"]
Sep 08 00:49:54.467865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.467830    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm" podUID="5354b04d-9305-4d18-a1bc-88d3bf21f056" containerName="payload-pre-processing" containerID="cri-o://b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858" gracePeriod=30
Sep 08 00:49:54.505334 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.504435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:54.603020 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.602976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:54.661351 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.661262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:54.750287 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.750258    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:49:54.788118 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.788086    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5354b04d-9305-4d18-a1bc-88d3bf21f056-plugins-config-volume\") pod \"5354b04d-9305-4d18-a1bc-88d3bf21f056\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") "
Sep 08 00:49:54.788336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.788172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhm2q\" (UniqueName: \"kubernetes.io/projected/5354b04d-9305-4d18-a1bc-88d3bf21f056-kube-api-access-dhm2q\") pod \"5354b04d-9305-4d18-a1bc-88d3bf21f056\" (UID: \"5354b04d-9305-4d18-a1bc-88d3bf21f056\") "
Sep 08 00:49:54.788494 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.788466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5354b04d-9305-4d18-a1bc-88d3bf21f056-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5354b04d-9305-4d18-a1bc-88d3bf21f056" (UID: "5354b04d-9305-4d18-a1bc-88d3bf21f056"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:49:54.788586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.788572    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5354b04d-9305-4d18-a1bc-88d3bf21f056-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:54.790271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.790247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5354b04d-9305-4d18-a1bc-88d3bf21f056-kube-api-access-dhm2q" (OuterVolumeSpecName: "kube-api-access-dhm2q") pod "5354b04d-9305-4d18-a1bc-88d3bf21f056" (UID: "5354b04d-9305-4d18-a1bc-88d3bf21f056"). InnerVolumeSpecName "kube-api-access-dhm2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:49:54.866541 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.866511    2578 generic.go:356] "Generic (PLEG): container finished" podID="5354b04d-9305-4d18-a1bc-88d3bf21f056" containerID="b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858" exitCode=0
Sep 08 00:49:54.866855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.866558    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"
Sep 08 00:49:54.866855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.866593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm" event={"ID":"5354b04d-9305-4d18-a1bc-88d3bf21f056","Type":"ContainerDied","Data":"b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858"}
Sep 08 00:49:54.866855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.866641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm" event={"ID":"5354b04d-9305-4d18-a1bc-88d3bf21f056","Type":"ContainerDied","Data":"4bac0fee5a761efba60ea07753252744b85034bf67de4749843af1dfef3711f5"}
Sep 08 00:49:54.866855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.866663    2578 scope.go:117] "RemoveContainer" containerID="b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858"
Sep 08 00:49:54.866855 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.866824    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" podUID="5972f7ed-a128-4ac3-b193-29c5edbcc932" containerName="maas-api" containerID="cri-o://fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5" gracePeriod=30
Sep 08 00:49:54.877246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.877226    2578 scope.go:117] "RemoveContainer" containerID="b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858"
Sep 08 00:49:54.877707 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:49:54.877655    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858\": container with ID starting with b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858 not found: ID does not exist" containerID="b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858"
Sep 08 00:49:54.877875 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.877845    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858"} err="failed to get container status \"b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858\": rpc error: code = NotFound desc = could not find container \"b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858\": container with ID starting with b0640050a8c0e5fada468028ba6b58c8f3924874b36820c826d5ba5e88b29858 not found: ID does not exist"
Sep 08 00:49:54.889202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.889185    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhm2q\" (UniqueName: \"kubernetes.io/projected/5354b04d-9305-4d18-a1bc-88d3bf21f056-kube-api-access-dhm2q\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:54.904335 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.904314    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"]
Sep 08 00:49:54.910358 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.910335    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1cf84f-f499cc56b-hkvvm"]
Sep 08 00:49:54.956654 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:54.956597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:55.103934 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.103912    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:49:55.192598 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.192574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5972f7ed-a128-4ac3-b193-29c5edbcc932-openshift-service-ca\") pod \"5972f7ed-a128-4ac3-b193-29c5edbcc932\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") "
Sep 08 00:49:55.192782 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.192618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-metrics-certs\") pod \"5972f7ed-a128-4ac3-b193-29c5edbcc932\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") "
Sep 08 00:49:55.192782 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.192636    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpvgd\" (UniqueName: \"kubernetes.io/projected/5972f7ed-a128-4ac3-b193-29c5edbcc932-kube-api-access-rpvgd\") pod \"5972f7ed-a128-4ac3-b193-29c5edbcc932\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") "
Sep 08 00:49:55.192782 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.192657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls\") pod \"5972f7ed-a128-4ac3-b193-29c5edbcc932\" (UID: \"5972f7ed-a128-4ac3-b193-29c5edbcc932\") "
Sep 08 00:49:55.192977 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.192936    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5972f7ed-a128-4ac3-b193-29c5edbcc932-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5972f7ed-a128-4ac3-b193-29c5edbcc932" (UID: "5972f7ed-a128-4ac3-b193-29c5edbcc932"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:49:55.193113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.193092    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5972f7ed-a128-4ac3-b193-29c5edbcc932-openshift-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:55.194678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.194647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5972f7ed-a128-4ac3-b193-29c5edbcc932" (UID: "5972f7ed-a128-4ac3-b193-29c5edbcc932"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:49:55.194678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.194655    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5972f7ed-a128-4ac3-b193-29c5edbcc932-kube-api-access-rpvgd" (OuterVolumeSpecName: "kube-api-access-rpvgd") pod "5972f7ed-a128-4ac3-b193-29c5edbcc932" (UID: "5972f7ed-a128-4ac3-b193-29c5edbcc932"). InnerVolumeSpecName "kube-api-access-rpvgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:49:55.194678 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.194674    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5972f7ed-a128-4ac3-b193-29c5edbcc932" (UID: "5972f7ed-a128-4ac3-b193-29c5edbcc932"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:49:55.294590 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.294568    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-metrics-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:55.294729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.294591    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpvgd\" (UniqueName: \"kubernetes.io/projected/5972f7ed-a128-4ac3-b193-29c5edbcc932-kube-api-access-rpvgd\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:55.294729 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.294602    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5972f7ed-a128-4ac3-b193-29c5edbcc932-maas-api-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:49:55.875376 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.875327    2578 generic.go:356] "Generic (PLEG): container finished" podID="5972f7ed-a128-4ac3-b193-29c5edbcc932" containerID="fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5" exitCode=0
Sep 08 00:49:55.875860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.875399    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"
Sep 08 00:49:55.875860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.875409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" event={"ID":"5972f7ed-a128-4ac3-b193-29c5edbcc932","Type":"ContainerDied","Data":"fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5"}
Sep 08 00:49:55.875860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.875473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt" event={"ID":"5972f7ed-a128-4ac3-b193-29c5edbcc932","Type":"ContainerDied","Data":"4b5e197c9983e87c77e40e5de4f573d7adc4eadd3645463d2a7b1e358400f11f"}
Sep 08 00:49:55.875860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.875505    2578 scope.go:117] "RemoveContainer" containerID="fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5"
Sep 08 00:49:55.890840 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.888488    2578 scope.go:117] "RemoveContainer" containerID="fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5"
Sep 08 00:49:55.893874 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:49:55.892461    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5\": container with ID starting with fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5 not found: ID does not exist" containerID="fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5"
Sep 08 00:49:55.893874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.892506    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5"} err="failed to get container status \"fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5\": rpc error: code = NotFound desc = could not find container \"fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5\": container with ID starting with fcb4a1c8f05063fc6612c2dcd3480961d8355391e5761b2321c9b230a9845cd5 not found: ID does not exist"
Sep 08 00:49:55.909382 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.909352    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"]
Sep 08 00:49:55.915100 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:55.915079    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1cf84f-5cd56b7b4-pp4zt"]
Sep 08 00:49:56.058578 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:56.058544    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5354b04d-9305-4d18-a1bc-88d3bf21f056" path="/var/lib/kubelet/pods/5354b04d-9305-4d18-a1bc-88d3bf21f056/volumes"
Sep 08 00:49:56.058994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:56.058980    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5972f7ed-a128-4ac3-b193-29c5edbcc932" path="/var/lib/kubelet/pods/5972f7ed-a128-4ac3-b193-29c5edbcc932/volumes"
Sep 08 00:49:57.233831 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:57.233798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:57.537214 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:57.537102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:49:57.779347 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:49:57.779313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:00.362375 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:00.362338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:00.460592 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:00.460560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:01.447949 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.447914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:01.541158 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.541119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:01.614380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.614347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:01.665426 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.665394    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"]
Sep 08 00:50:01.665672 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.665647    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy" containerID="cri-o://d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428" gracePeriod=30
Sep 08 00:50:01.700958 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.700886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:01.943636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:01.943601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:02.088356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.088323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:02.189360 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.189323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:02.198842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.198810    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"]
Sep 08 00:50:02.199299 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.199282    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5354b04d-9305-4d18-a1bc-88d3bf21f056" containerName="payload-pre-processing"
Sep 08 00:50:02.199389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.199301    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5354b04d-9305-4d18-a1bc-88d3bf21f056" containerName="payload-pre-processing"
Sep 08 00:50:02.199389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.199329    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5972f7ed-a128-4ac3-b193-29c5edbcc932" containerName="maas-api"
Sep 08 00:50:02.199389 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.199338    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5972f7ed-a128-4ac3-b193-29c5edbcc932" containerName="maas-api"
Sep 08 00:50:02.199543 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.199442    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5354b04d-9305-4d18-a1bc-88d3bf21f056" containerName="payload-pre-processing"
Sep 08 00:50:02.199543 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.199456    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5972f7ed-a128-4ac3-b193-29c5edbcc932" containerName="maas-api"
Sep 08 00:50:02.204244 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.204224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.207235 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.207210    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c28b2155\""
Sep 08 00:50:02.207343 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.207277    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c28b2155-dockercfg-bhb4w\""
Sep 08 00:50:02.212165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.212147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"]
Sep 08 00:50:02.231728 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.231708    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"]
Sep 08 00:50:02.235178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.235160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.245183 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.245163    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"]
Sep 08 00:50:02.268164 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.268141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91ff63f3-f725-4ba3-893c-bd1f6aacad09-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.268352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.268332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cppm\" (UniqueName: \"kubernetes.io/projected/91ff63f3-f725-4ba3-893c-bd1f6aacad09-kube-api-access-9cppm\") pod \"payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.369899 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.369816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ds57\" (UniqueName: \"kubernetes.io/projected/1c92fa02-4913-48f8-8ceb-765c187bf57f-kube-api-access-6ds57\") pod \"payload-processing-e2e-mt-c28b2155-5db4b665-225lc\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") " pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.369899 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.369863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c92fa02-4913-48f8-8ceb-765c187bf57f-plugins-config-volume\") pod \"payload-processing-e2e-mt-c28b2155-5db4b665-225lc\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") " pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.370087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.369976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cppm\" (UniqueName: \"kubernetes.io/projected/91ff63f3-f725-4ba3-893c-bd1f6aacad09-kube-api-access-9cppm\") pod \"payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.370087 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.370020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91ff63f3-f725-4ba3-893c-bd1f6aacad09-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.370677 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.370660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91ff63f3-f725-4ba3-893c-bd1f6aacad09-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.379246 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.379219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cppm\" (UniqueName: \"kubernetes.io/projected/91ff63f3-f725-4ba3-893c-bd1f6aacad09-kube-api-access-9cppm\") pod \"payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.471324 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.471299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ds57\" (UniqueName: \"kubernetes.io/projected/1c92fa02-4913-48f8-8ceb-765c187bf57f-kube-api-access-6ds57\") pod \"payload-processing-e2e-mt-c28b2155-5db4b665-225lc\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") " pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.471695 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.471349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c92fa02-4913-48f8-8ceb-765c187bf57f-plugins-config-volume\") pod \"payload-processing-e2e-mt-c28b2155-5db4b665-225lc\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") " pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.472059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.472042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c92fa02-4913-48f8-8ceb-765c187bf57f-plugins-config-volume\") pod \"payload-processing-e2e-mt-c28b2155-5db4b665-225lc\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") " pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.479756 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.479723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ds57\" (UniqueName: \"kubernetes.io/projected/1c92fa02-4913-48f8-8ceb-765c187bf57f-kube-api-access-6ds57\") pod \"payload-processing-e2e-mt-c28b2155-5db4b665-225lc\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") " pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.487016 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.486992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:02.515911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.515883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.545700 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.545626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.793650 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.793627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"]
Sep 08 00:50:02.795773 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:50:02.795749    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ff63f3_f725_4ba3_893c_bd1f6aacad09.slice/crio-eb9b90b4cf20bbb637579cca38502c973afb9b558b99d3c8ba197d452d3c8357 WatchSource:0}: Error finding container eb9b90b4cf20bbb637579cca38502c973afb9b558b99d3c8ba197d452d3c8357: Status 404 returned error can't find the container with id eb9b90b4cf20bbb637579cca38502c973afb9b558b99d3c8ba197d452d3c8357
Sep 08 00:50:02.839060 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.839037    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"]
Sep 08 00:50:02.845795 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:50:02.845767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c92fa02_4913_48f8_8ceb_765c187bf57f.slice/crio-bc2b084e074654f6a970f95b3914927b97a51cdd744b3bee9548a30d89c7ab61 WatchSource:0}: Error finding container bc2b084e074654f6a970f95b3914927b97a51cdd744b3bee9548a30d89c7ab61: Status 404 returned error can't find the container with id bc2b084e074654f6a970f95b3914927b97a51cdd744b3bee9548a30d89c7ab61
Sep 08 00:50:02.920744 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.920715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg" event={"ID":"91ff63f3-f725-4ba3-893c-bd1f6aacad09","Type":"ContainerStarted","Data":"763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989"}
Sep 08 00:50:02.920871 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.920780    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg" event={"ID":"91ff63f3-f725-4ba3-893c-bd1f6aacad09","Type":"ContainerStarted","Data":"eb9b90b4cf20bbb637579cca38502c973afb9b558b99d3c8ba197d452d3c8357"}
Sep 08 00:50:02.920956 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.920936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:02.922541 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.922517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc" event={"ID":"1c92fa02-4913-48f8-8ceb-765c187bf57f","Type":"ContainerStarted","Data":"94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5"}
Sep 08 00:50:02.922648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.922558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc" event={"ID":"1c92fa02-4913-48f8-8ceb-765c187bf57f","Type":"ContainerStarted","Data":"bc2b084e074654f6a970f95b3914927b97a51cdd744b3bee9548a30d89c7ab61"}
Sep 08 00:50:02.922648 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.922585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:02.938557 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.938502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg" podStartSLOduration=0.93848471 podStartE2EDuration="938.48471ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:50:02.935294754 +0000 UTC m=+1025.313668186" watchObservedRunningTime="2026-09-08 00:50:02.93848471 +0000 UTC m=+1025.316858144"
Sep 08 00:50:02.952170 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:02.952131    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc" podStartSLOduration=0.952117233 podStartE2EDuration="952.117233ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:50:02.950393325 +0000 UTC m=+1025.328766757" watchObservedRunningTime="2026-09-08 00:50:02.952117233 +0000 UTC m=+1025.330490665"
Sep 08 00:50:03.350248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:03.350207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:06.922468 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.922443    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:50:06.959962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.959891    2578 generic.go:356] "Generic (PLEG): container finished" podID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerID="d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428" exitCode=0
Sep 08 00:50:06.959962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.959934    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"
Sep 08 00:50:06.960117 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.959963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" event={"ID":"d611488d-7e41-4642-90c9-b8bedf9ed262","Type":"ContainerDied","Data":"d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428"}
Sep 08 00:50:06.960117 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.960011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c" event={"ID":"d611488d-7e41-4642-90c9-b8bedf9ed262","Type":"ContainerDied","Data":"d4ddd8c8a9db5fbec0ffbe306dbae6af1600c03b5afbb194c780e9f57761d7ae"}
Sep 08 00:50:06.960117 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.960035    2578 scope.go:117] "RemoveContainer" containerID="d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428"
Sep 08 00:50:06.972754 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.972737    2578 scope.go:117] "RemoveContainer" containerID="16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"
Sep 08 00:50:06.983470 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.983362    2578 scope.go:117] "RemoveContainer" containerID="d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428"
Sep 08 00:50:06.983726 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:50:06.983705    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428\": container with ID starting with d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428 not found: ID does not exist" containerID="d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428"
Sep 08 00:50:06.983797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.983735    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428"} err="failed to get container status \"d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428\": rpc error: code = NotFound desc = could not find container \"d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428\": container with ID starting with d470d14649cc5e9fe4b3816a8ef046ed237182c59402f72b0cd2d46c70381428 not found: ID does not exist"
Sep 08 00:50:06.983797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.983753    2578 scope.go:117] "RemoveContainer" containerID="16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"
Sep 08 00:50:06.983987 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:50:06.983969    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6\": container with ID starting with 16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6 not found: ID does not exist" containerID="16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"
Sep 08 00:50:06.984034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:06.983993    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6"} err="failed to get container status \"16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6\": rpc error: code = NotFound desc = could not find container \"16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6\": container with ID starting with 16d6c65a96bdb63c6e093d1e49dbfffe07a436f7d33a2622c88a07a443962dd6 not found: ID does not exist"
Sep 08 00:50:07.020204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020183    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-envoy\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020281 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-podinfo\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020281 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020265    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-socket\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020362 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020333    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qvx8\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-kube-api-access-7qvx8\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020408 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020399    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-certs\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020458 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020423    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-token\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020467    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-data\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d611488d-7e41-4642-90c9-b8bedf9ed262-istiod-ca-cert\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020629 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:50:07.020629 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-credential-socket\") pod \"d611488d-7e41-4642-90c9-b8bedf9ed262\" (UID: \"d611488d-7e41-4642-90c9-b8bedf9ed262\") "
Sep 08 00:50:07.020766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:50:07.020827 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020780    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-data" (OuterVolumeSpecName: "istio-data") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:50:07.020888 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d611488d-7e41-4642-90c9-b8bedf9ed262-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:50:07.021022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.020999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:50:07.021126 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.021102    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.021202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.021131    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d611488d-7e41-4642-90c9-b8bedf9ed262-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.021202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.021148    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.021202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.021179    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.021202 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.021194    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.022435 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.022407    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:50:07.022673 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.022653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:50:07.022755 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.022699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-kube-api-access-7qvx8" (OuterVolumeSpecName: "kube-api-access-7qvx8") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "kube-api-access-7qvx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:50:07.022850 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.022828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-token" (OuterVolumeSpecName: "istio-token") pod "d611488d-7e41-4642-90c9-b8bedf9ed262" (UID: "d611488d-7e41-4642-90c9-b8bedf9ed262"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:50:07.121946 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.121922    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.121946 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.121942    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.122075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.121952    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qvx8\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-kube-api-access-7qvx8\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.122075 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.121960    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d611488d-7e41-4642-90c9-b8bedf9ed262-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:50:07.282767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.282739    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"]
Sep 08 00:50:07.286316 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:07.286278    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1cf84f-openshift-default-757b6b9778-jc47c"]
Sep 08 00:50:08.057918 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:08.057883    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" path="/var/lib/kubelet/pods/d611488d-7e41-4642-90c9-b8bedf9ed262/volumes"
Sep 08 00:50:12.127223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:12.127184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:12.717448 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:12.717399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:12.785511 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:12.785469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:12.856174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:12.856142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:12.919166 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:12.919132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:13.252332 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:13.252300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:13.939297 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:13.939267    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:50:13.939605 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:13.939583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:50:19.025529 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:19.025493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:19.126440 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:19.126406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:19.266585 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:19.266550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:19.769425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:19.769387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:20.066112 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:20.066078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:20.303636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:20.303590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:22.482536 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:22.482489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:23.336507 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:23.336466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:23.526793 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:23.526755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:23.675848 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:23.675747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:24.663955 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:24.663917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:24.765460 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:24.765422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:24.982367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:24.982257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:25.248778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:25.248671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:25.343323 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:25.343281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:48.421098 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:48.421051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:48.740586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:48.740469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:49.004659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.004585    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"]
Sep 08 00:50:49.005165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.005144    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy"
Sep 08 00:50:49.005165 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.005163    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy"
Sep 08 00:50:49.005306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.005264    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy"
Sep 08 00:50:49.005306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.005275    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy"
Sep 08 00:50:49.009833 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.009815    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.012230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.012212    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-a8e810-openshift-default-dockercfg-h2t6l\""
Sep 08 00:50:49.020418 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.020398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"]
Sep 08 00:50:49.032162 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.032135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:49.104863 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.104816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-token\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105028 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6v66\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-kube-api-access-d6v66\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105077 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-data\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105118 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-credential-socket\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105164 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-socket\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105201 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istiod-ca-cert\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105234 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-certs\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105269 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-envoy\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.105306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.105295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-podinfo\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206088 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6v66\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-kube-api-access-d6v66\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-data\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-credential-socket\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-socket\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istiod-ca-cert\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-certs\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206280 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-envoy\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206617 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-podinfo\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206617 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-token\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.206761 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.206608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-data\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.207189 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.207034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istiod-ca-cert\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.207189 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.207147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-socket\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.207412 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.207205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-credential-socket\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.207862 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.207836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-certs\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.209364 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.209340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-envoy\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.209888 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.209860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-podinfo\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.222929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.220508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-token\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.225900 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.225873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6v66\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-kube-api-access-d6v66\") pod \"e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") " pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.303597 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.303570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:49.323022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.322996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:49.607845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.607260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"]
Sep 08 00:50:49.608208 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:50:49.608036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6ceec9_4d7b_4df3_b805_1741b8ecfb7b.slice/crio-17ee75a8d203584ec15be3f350175e0b5500530aa819f7f1e47f5fa8cc156a9b WatchSource:0}: Error finding container 17ee75a8d203584ec15be3f350175e0b5500530aa819f7f1e47f5fa8cc156a9b: Status 404 returned error can't find the container with id 17ee75a8d203584ec15be3f350175e0b5500530aa819f7f1e47f5fa8cc156a9b
Sep 08 00:50:49.611152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.611042    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:50:49.611152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.611111    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:50:49.611152 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:49.611147    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:50:50.224794 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:50.224761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" event={"ID":"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b","Type":"ContainerStarted","Data":"5c58db196874debe07b1b7bca7f9d5f909e4453aaa3c9b1bad6bc7c74c44896e"}
Sep 08 00:50:50.224956 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:50.224812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" event={"ID":"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b","Type":"ContainerStarted","Data":"17ee75a8d203584ec15be3f350175e0b5500530aa819f7f1e47f5fa8cc156a9b"}
Sep 08 00:50:50.248313 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:50.248260    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podStartSLOduration=2.248247453 podStartE2EDuration="2.248247453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:50:50.24577877 +0000 UTC m=+1072.624152203" watchObservedRunningTime="2026-09-08 00:50:50.248247453 +0000 UTC m=+1072.626620885"
Sep 08 00:50:50.323962 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:50.323939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:50.329178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:50.329157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:51.230951 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:51.230872    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:51.231722 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:51.231702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:50:52.116370 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:52.116332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:52.210701 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:52.210644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:53.252301 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.252265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:53.355773 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.355736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:53.754352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.754311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:53.836307 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.836270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:50:53.933742 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.933710    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"]
Sep 08 00:50:53.934188 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.934175    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy"
Sep 08 00:50:53.934236 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.934190    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d611488d-7e41-4642-90c9-b8bedf9ed262" containerName="istio-proxy"
Sep 08 00:50:53.937551 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.937530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:53.940035 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.940014    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-a8e810\""
Sep 08 00:50:53.940134 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.940020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-a8e810-dockercfg-fbrqw\""
Sep 08 00:50:53.947521 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:53.947498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"]
Sep 08 00:50:54.052956 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.052923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d585b1a-e1a1-49af-8e33-4fff104530cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.053130 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.053067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfvs6\" (UniqueName: \"kubernetes.io/projected/4d585b1a-e1a1-49af-8e33-4fff104530cd-kube-api-access-pfvs6\") pod \"payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.153924 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.153892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d585b1a-e1a1-49af-8e33-4fff104530cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.154100 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.153989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfvs6\" (UniqueName: \"kubernetes.io/projected/4d585b1a-e1a1-49af-8e33-4fff104530cd-kube-api-access-pfvs6\") pod \"payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.154659 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.154632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d585b1a-e1a1-49af-8e33-4fff104530cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.161944 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.161922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfvs6\" (UniqueName: \"kubernetes.io/projected/4d585b1a-e1a1-49af-8e33-4fff104530cd-kube-api-access-pfvs6\") pod \"payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.249509 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.249485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:54.521983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:54.521947    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"]
Sep 08 00:50:54.523268 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:50:54.523244    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d585b1a_e1a1_49af_8e33_4fff104530cd.slice/crio-8447a57b9ba977f0e7720f5f8025c01eb60182c4d7b8b294fa23ab324a5dc909 WatchSource:0}: Error finding container 8447a57b9ba977f0e7720f5f8025c01eb60182c4d7b8b294fa23ab324a5dc909: Status 404 returned error can't find the container with id 8447a57b9ba977f0e7720f5f8025c01eb60182c4d7b8b294fa23ab324a5dc909
Sep 08 00:50:55.256857 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:55.256820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp" event={"ID":"4d585b1a-e1a1-49af-8e33-4fff104530cd","Type":"ContainerStarted","Data":"16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542"}
Sep 08 00:50:55.257136 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:55.257114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp" event={"ID":"4d585b1a-e1a1-49af-8e33-4fff104530cd","Type":"ContainerStarted","Data":"8447a57b9ba977f0e7720f5f8025c01eb60182c4d7b8b294fa23ab324a5dc909"}
Sep 08 00:50:55.257272 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:55.257248    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:50:55.285509 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:55.285455    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp" podStartSLOduration=2.285436025 podStartE2EDuration="2.285436025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:50:55.284224339 +0000 UTC m=+1077.662597772" watchObservedRunningTime="2026-09-08 00:50:55.285436025 +0000 UTC m=+1077.663809460"
Sep 08 00:50:55.930314 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:50:55.930267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:06.264521 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:06.264486    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:51:14.368785 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:14.368755    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerID="5c58db196874debe07b1b7bca7f9d5f909e4453aaa3c9b1bad6bc7c74c44896e" exitCode=0
Sep 08 00:51:14.369148 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:14.368836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" event={"ID":"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b","Type":"ContainerDied","Data":"5c58db196874debe07b1b7bca7f9d5f909e4453aaa3c9b1bad6bc7c74c44896e"}
Sep 08 00:51:14.369261 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:14.369246    2578 scope.go:117] "RemoveContainer" containerID="5c58db196874debe07b1b7bca7f9d5f909e4453aaa3c9b1bad6bc7c74c44896e"
Sep 08 00:51:14.370413 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:14.370386    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:51:14.370483 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:14.370454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:51:14.370520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:14.370488    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:51:15.377974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:15.377939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" event={"ID":"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b","Type":"ContainerStarted","Data":"81212be44251f32019232a22927c94ec8500374045496bd412aeceaba95117aa"}
Sep 08 00:51:15.865520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:15.865482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:16.323352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:16.323324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:51:16.323585 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:16.323561    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 00:51:16.323634 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:16.323612    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 00:51:17.050041 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:17.049989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:17.324434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:17.324357    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 00:51:17.324634 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:17.324612    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 00:51:18.323430 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:18.323396    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 00:51:18.323918 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:18.323457    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 00:51:19.323478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:19.323445    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 00:51:19.324009 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:19.323502    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 00:51:20.324244 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:20.324205    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 08 00:51:20.324633 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:20.324261    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 08 00:51:21.231355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:21.231321    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:51:21.327819 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:21.327791    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:51:21.422151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:21.422128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:51:35.164994 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:35.164949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:36.593865 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:36.593823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:41.255380 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:41.255341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:56.606983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.606945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:56.634860 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.634831    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"]
Sep 08 00:51:56.635133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.635055    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc" podUID="1c92fa02-4913-48f8-8ceb-765c187bf57f" containerName="payload-processing" containerID="cri-o://94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5" gracePeriod=30
Sep 08 00:51:56.645576 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.645540    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"]
Sep 08 00:51:56.646048 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.645818    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg" podUID="91ff63f3-f725-4ba3-893c-bd1f6aacad09" containerName="payload-pre-processing" containerID="cri-o://763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989" gracePeriod=30
Sep 08 00:51:56.673055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.673026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:56.730069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.730032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:56.803379 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.803340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:56.858967 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.858885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:51:56.937975 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.937954    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:51:56.951158 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:56.951139    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:51:57.086192 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086147    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91ff63f3-f725-4ba3-893c-bd1f6aacad09-plugins-config-volume\") pod \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") "
Sep 08 00:51:57.086392 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c92fa02-4913-48f8-8ceb-765c187bf57f-plugins-config-volume\") pod \"1c92fa02-4913-48f8-8ceb-765c187bf57f\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") "
Sep 08 00:51:57.086392 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086269    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cppm\" (UniqueName: \"kubernetes.io/projected/91ff63f3-f725-4ba3-893c-bd1f6aacad09-kube-api-access-9cppm\") pod \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\" (UID: \"91ff63f3-f725-4ba3-893c-bd1f6aacad09\") "
Sep 08 00:51:57.086392 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ds57\" (UniqueName: \"kubernetes.io/projected/1c92fa02-4913-48f8-8ceb-765c187bf57f-kube-api-access-6ds57\") pod \"1c92fa02-4913-48f8-8ceb-765c187bf57f\" (UID: \"1c92fa02-4913-48f8-8ceb-765c187bf57f\") "
Sep 08 00:51:57.086560 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff63f3-f725-4ba3-893c-bd1f6aacad09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91ff63f3-f725-4ba3-893c-bd1f6aacad09" (UID: "91ff63f3-f725-4ba3-893c-bd1f6aacad09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:51:57.086623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c92fa02-4913-48f8-8ceb-765c187bf57f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c92fa02-4913-48f8-8ceb-765c187bf57f" (UID: "1c92fa02-4913-48f8-8ceb-765c187bf57f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:51:57.086703 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.086600    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91ff63f3-f725-4ba3-893c-bd1f6aacad09-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:51:57.088297 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.088273    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c92fa02-4913-48f8-8ceb-765c187bf57f-kube-api-access-6ds57" (OuterVolumeSpecName: "kube-api-access-6ds57") pod "1c92fa02-4913-48f8-8ceb-765c187bf57f" (UID: "1c92fa02-4913-48f8-8ceb-765c187bf57f"). InnerVolumeSpecName "kube-api-access-6ds57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:51:57.088410 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.088307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ff63f3-f725-4ba3-893c-bd1f6aacad09-kube-api-access-9cppm" (OuterVolumeSpecName: "kube-api-access-9cppm") pod "91ff63f3-f725-4ba3-893c-bd1f6aacad09" (UID: "91ff63f3-f725-4ba3-893c-bd1f6aacad09"). InnerVolumeSpecName "kube-api-access-9cppm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:51:57.187217 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.187155    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cppm\" (UniqueName: \"kubernetes.io/projected/91ff63f3-f725-4ba3-893c-bd1f6aacad09-kube-api-access-9cppm\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:51:57.187217 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.187177    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ds57\" (UniqueName: \"kubernetes.io/projected/1c92fa02-4913-48f8-8ceb-765c187bf57f-kube-api-access-6ds57\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:51:57.187217 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.187193    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c92fa02-4913-48f8-8ceb-765c187bf57f-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:51:57.636242 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.636206    2578 generic.go:356] "Generic (PLEG): container finished" podID="91ff63f3-f725-4ba3-893c-bd1f6aacad09" containerID="763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989" exitCode=0
Sep 08 00:51:57.636641 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.636267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"
Sep 08 00:51:57.636641 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.636291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg" event={"ID":"91ff63f3-f725-4ba3-893c-bd1f6aacad09","Type":"ContainerDied","Data":"763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989"}
Sep 08 00:51:57.636641 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.636343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg" event={"ID":"91ff63f3-f725-4ba3-893c-bd1f6aacad09","Type":"ContainerDied","Data":"eb9b90b4cf20bbb637579cca38502c973afb9b558b99d3c8ba197d452d3c8357"}
Sep 08 00:51:57.636641 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.636366    2578 scope.go:117] "RemoveContainer" containerID="763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989"
Sep 08 00:51:57.637814 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.637793    2578 generic.go:356] "Generic (PLEG): container finished" podID="1c92fa02-4913-48f8-8ceb-765c187bf57f" containerID="94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5" exitCode=0
Sep 08 00:51:57.637932 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.637857    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"
Sep 08 00:51:57.637932 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.637864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc" event={"ID":"1c92fa02-4913-48f8-8ceb-765c187bf57f","Type":"ContainerDied","Data":"94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5"}
Sep 08 00:51:57.637932 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.637908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc" event={"ID":"1c92fa02-4913-48f8-8ceb-765c187bf57f","Type":"ContainerDied","Data":"bc2b084e074654f6a970f95b3914927b97a51cdd744b3bee9548a30d89c7ab61"}
Sep 08 00:51:57.648342 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.648323    2578 scope.go:117] "RemoveContainer" containerID="763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989"
Sep 08 00:51:57.648621 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:51:57.648599    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989\": container with ID starting with 763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989 not found: ID does not exist" containerID="763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989"
Sep 08 00:51:57.648753 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.648631    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989"} err="failed to get container status \"763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989\": rpc error: code = NotFound desc = could not find container \"763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989\": container with ID starting with 763b7e75e55e13b415bc14969c9f2c12e59c8ef2909232ae738b5895509b9989 not found: ID does not exist"
Sep 08 00:51:57.648753 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.648654    2578 scope.go:117] "RemoveContainer" containerID="94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5"
Sep 08 00:51:57.657611 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.657594    2578 scope.go:117] "RemoveContainer" containerID="94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5"
Sep 08 00:51:57.657872 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:51:57.657853    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5\": container with ID starting with 94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5 not found: ID does not exist" containerID="94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5"
Sep 08 00:51:57.657929 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.657878    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5"} err="failed to get container status \"94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5\": rpc error: code = NotFound desc = could not find container \"94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5\": container with ID starting with 94b50a1f94a4e35bd3609cc86a5418ce54d900628a88516815c49262705fc5d5 not found: ID does not exist"
Sep 08 00:51:57.670499 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.670479    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"]
Sep 08 00:51:57.674826 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.674787    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c28b2155-59b79dcbbb-6jmbg"]
Sep 08 00:51:57.685017 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.684996    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"]
Sep 08 00:51:57.688869 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:57.688850    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c28b2155-5db4b665-225lc"]
Sep 08 00:51:58.058266 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:58.058229    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c92fa02-4913-48f8-8ceb-765c187bf57f" path="/var/lib/kubelet/pods/1c92fa02-4913-48f8-8ceb-765c187bf57f/volumes"
Sep 08 00:51:58.058636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:58.058622    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ff63f3-f725-4ba3-893c-bd1f6aacad09" path="/var/lib/kubelet/pods/91ff63f3-f725-4ba3-893c-bd1f6aacad09/volumes"
Sep 08 00:51:59.747984 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:51:59.747951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:04.774611 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:04.774564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:29.433535 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:29.433445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:41.226727 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:41.226660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:41.624498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:41.624448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:47.280425 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:47.280382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:47.337186 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:47.337160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:47.614338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:47.614300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:48.736171 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:48.736131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:48.832974 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:48.832940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:48.932646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:48.932608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:49.506366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:49.506324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:49.603981 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:49.603929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:49.701734 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:49.701700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:50.837356 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:50.837318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:56.618004 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:56.617964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:56.679519 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:56.679491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:52:57.281809 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:52:57.281760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:03.183789 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:03.183740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:03.284989 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:03.284954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:03.386427 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:03.386392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:13.846240 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:13.846205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:14.071706 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:14.071649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:34.978131 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:34.978092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:40.754749 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:40.754710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:40.815340 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:40.815304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:41.077817 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.077787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:41.328109 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328042    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"]
Sep 08 00:53:41.328487 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328473    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92fa02-4913-48f8-8ceb-765c187bf57f" containerName="payload-processing"
Sep 08 00:53:41.328530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328489    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92fa02-4913-48f8-8ceb-765c187bf57f" containerName="payload-processing"
Sep 08 00:53:41.328530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328504    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff63f3-f725-4ba3-893c-bd1f6aacad09" containerName="payload-pre-processing"
Sep 08 00:53:41.328530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328510    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff63f3-f725-4ba3-893c-bd1f6aacad09" containerName="payload-pre-processing"
Sep 08 00:53:41.328624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328582    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff63f3-f725-4ba3-893c-bd1f6aacad09" containerName="payload-pre-processing"
Sep 08 00:53:41.328624 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.328593    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c92fa02-4913-48f8-8ceb-765c187bf57f" containerName="payload-processing"
Sep 08 00:53:41.332504 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.332485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.335083 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.335061    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-55b1e9-openshift-default-dockercfg-9v9cs\""
Sep 08 00:53:41.344831 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.344809    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"]
Sep 08 00:53:41.349858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.349831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:41.442842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.442797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-data\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443443 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4lzl\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-kube-api-access-n4lzl\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-podinfo\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443665 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-certs\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443757 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-socket\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443757 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052ac600-556c-4cdb-9233-0332e68cf9d3-istiod-ca-cert\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443878 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-token\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443878 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-envoy\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.443980 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.443889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-credential-socket\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545351 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-data\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4lzl\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-kube-api-access-n4lzl\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-podinfo\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545478 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-certs\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-socket\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545645 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052ac600-556c-4cdb-9233-0332e68cf9d3-istiod-ca-cert\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545791 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-token\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545791 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-envoy\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545791 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-credential-socket\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-data\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-socket\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.545983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.545864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-certs\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.546110 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.546080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-credential-socket\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.546387 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.546359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052ac600-556c-4cdb-9233-0332e68cf9d3-istiod-ca-cert\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.547910 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.547886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-envoy\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.548122 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.548106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-podinfo\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.554291 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.554262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-token\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.554404 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.554303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4lzl\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-kube-api-access-n4lzl\") pod \"e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") " pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.644142 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.644081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:41.859618 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.859579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:41.924394 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.924149    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"]
Sep 08 00:53:41.927059 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:53:41.927022    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052ac600_556c_4cdb_9233_0332e68cf9d3.slice/crio-a0fd9ab732b38fd42b49bd0ebd3e191ab17f74655709a6f9fb6bbcede0cf083e WatchSource:0}: Error finding container a0fd9ab732b38fd42b49bd0ebd3e191ab17f74655709a6f9fb6bbcede0cf083e: Status 404 returned error can't find the container with id a0fd9ab732b38fd42b49bd0ebd3e191ab17f74655709a6f9fb6bbcede0cf083e
Sep 08 00:53:41.929664 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.929628    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:53:41.929766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.929721    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:53:41.929766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:41.929759    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:53:42.246854 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:42.246753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" event={"ID":"052ac600-556c-4cdb-9233-0332e68cf9d3","Type":"ContainerStarted","Data":"da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"}
Sep 08 00:53:42.246854 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:42.246817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" event={"ID":"052ac600-556c-4cdb-9233-0332e68cf9d3","Type":"ContainerStarted","Data":"a0fd9ab732b38fd42b49bd0ebd3e191ab17f74655709a6f9fb6bbcede0cf083e"}
Sep 08 00:53:42.270983 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:42.270933    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podStartSLOduration=1.270917042 podStartE2EDuration="1.270917042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:53:42.269253314 +0000 UTC m=+1244.647626761" watchObservedRunningTime="2026-09-08 00:53:42.270917042 +0000 UTC m=+1244.649290498"
Sep 08 00:53:42.645204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:42.645166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:42.649803 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:42.649780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:43.252111 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:43.252077    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:43.253258 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:43.253232    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:53:44.177926 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:44.177886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:44.265886 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:44.265844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:45.359024 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:45.358988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:45.420144 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:45.420113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:45.616585 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:45.616498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:45.917467 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:45.917379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:46.019044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.019002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:53:46.024418 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.024393    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"]
Sep 08 00:53:46.028230 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.028215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.030640 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.030619    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-55b1e9\""
Sep 08 00:53:46.030754 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.030646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-55b1e9-dockercfg-frd7n\""
Sep 08 00:53:46.036788 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.036766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"]
Sep 08 00:53:46.092102 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.092076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab836ea-9fe2-4559-9a94-460a7a16062f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.092255 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.092122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phk4j\" (UniqueName: \"kubernetes.io/projected/bab836ea-9fe2-4559-9a94-460a7a16062f-kube-api-access-phk4j\") pod \"payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.193136 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.193054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab836ea-9fe2-4559-9a94-460a7a16062f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.193136 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.193114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phk4j\" (UniqueName: \"kubernetes.io/projected/bab836ea-9fe2-4559-9a94-460a7a16062f-kube-api-access-phk4j\") pod \"payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.193760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.193741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab836ea-9fe2-4559-9a94-460a7a16062f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.201393 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.201364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phk4j\" (UniqueName: \"kubernetes.io/projected/bab836ea-9fe2-4559-9a94-460a7a16062f-kube-api-access-phk4j\") pod \"payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.339486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.339461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:46.612069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:46.611899    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"]
Sep 08 00:53:46.614794 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:53:46.614768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab836ea_9fe2_4559_9a94_460a7a16062f.slice/crio-5d24c74355277c2284d63987e528bd8e8b4b5389c85eae12cbb0f2a405cd2337 WatchSource:0}: Error finding container 5d24c74355277c2284d63987e528bd8e8b4b5389c85eae12cbb0f2a405cd2337: Status 404 returned error can't find the container with id 5d24c74355277c2284d63987e528bd8e8b4b5389c85eae12cbb0f2a405cd2337
Sep 08 00:53:47.276497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:47.276464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv" event={"ID":"bab836ea-9fe2-4559-9a94-460a7a16062f","Type":"ContainerStarted","Data":"e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b"}
Sep 08 00:53:47.276669 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:47.276514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv" event={"ID":"bab836ea-9fe2-4559-9a94-460a7a16062f","Type":"ContainerStarted","Data":"5d24c74355277c2284d63987e528bd8e8b4b5389c85eae12cbb0f2a405cd2337"}
Sep 08 00:53:47.276766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:47.276677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:53:47.294006 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:47.293954    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv" podStartSLOduration=1.29393538 podStartE2EDuration="1.29393538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:53:47.292353654 +0000 UTC m=+1249.670727088" watchObservedRunningTime="2026-09-08 00:53:47.29393538 +0000 UTC m=+1249.672308813"
Sep 08 00:53:58.285938 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:53:58.285853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:54:02.369699 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:02.369656    2578 generic.go:356] "Generic (PLEG): container finished" podID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerID="da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361" exitCode=0
Sep 08 00:54:02.370098 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:02.369716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" event={"ID":"052ac600-556c-4cdb-9233-0332e68cf9d3","Type":"ContainerDied","Data":"da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"}
Sep 08 00:54:02.370146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:02.370114    2578 scope.go:117] "RemoveContainer" containerID="da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"
Sep 08 00:54:02.371223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:02.371193    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:02.371277 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:02.371264    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:02.371314 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:02.371299    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:03.379935 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:03.379889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" event={"ID":"052ac600-556c-4cdb-9233-0332e68cf9d3","Type":"ContainerStarted","Data":"b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961"}
Sep 08 00:54:03.644866 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:03.644785    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:54:03.645004 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:03.644970    2578 patch_prober.go:28] interesting pod/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 08 00:54:03.645067 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:03.645018    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 08 00:54:04.644377 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:04.644342    2578 patch_prober.go:28] interesting pod/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 08 00:54:04.644787 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:04.644398    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 08 00:54:05.644936 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:05.644901    2578 patch_prober.go:28] interesting pod/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 08 00:54:05.645322 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:05.644964    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 08 00:54:06.644499 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:06.644464    2578 patch_prober.go:28] interesting pod/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 08 00:54:06.644709 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:06.644526    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 08 00:54:07.645076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:07.645038    2578 patch_prober.go:28] interesting pod/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 08 00:54:07.645466 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:07.645087    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 08 00:54:08.648922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:08.648892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:54:08.649288 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:08.649242    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:54:08.649939 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:08.649920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:54:09.056490 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.056457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:09.500588 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.500498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:09.764451 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.764370    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"]
Sep 08 00:54:09.767430 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.767413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.769767 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.769747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3e8800-openshift-default-dockercfg-p4kjg\""
Sep 08 00:54:09.782628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.782606    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"]
Sep 08 00:54:09.794940 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.794907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:09.943059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-podinfo\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-socket\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943331 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-token\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943331 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-certs\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943331 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-778t7\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-kube-api-access-778t7\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943495 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-envoy\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943495 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-data\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943495 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dc9d80e-7203-4996-89e3-5974f1e216d9-istiod-ca-cert\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:09.943646 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:09.943494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-credential-socket\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.013522 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.013478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:10.044588 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-credential-socket\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.044737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-podinfo\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.044737 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-socket\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.044874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-token\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.044874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-certs\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.044874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-778t7\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-kube-api-access-778t7\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045031 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-envoy\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045031 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-data\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045031 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dc9d80e-7203-4996-89e3-5974f1e216d9-istiod-ca-cert\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045031 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.044999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-credential-socket\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045278 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.045066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-socket\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045373 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.045350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-data\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045514 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.045493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-certs\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.045754 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.045732    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dc9d80e-7203-4996-89e3-5974f1e216d9-istiod-ca-cert\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.047108 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.047090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-envoy\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.047443 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.047422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-podinfo\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.052853 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.052830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-778t7\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-kube-api-access-778t7\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.053414 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.053393    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-token\") pod \"e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") " pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.084308 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.084285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:10.377421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.375552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"]
Sep 08 00:54:10.377421 ip-10-0-140-137 kubenswrapper[2578]: W0908 00:54:10.376365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc9d80e_7203_4996_89e3_5974f1e216d9.slice/crio-98c8614919e4d46a000bd440e2f90d2e206b9f2f94bb263eddefe98c1d95c4a2 WatchSource:0}: Error finding container 98c8614919e4d46a000bd440e2f90d2e206b9f2f94bb263eddefe98c1d95c4a2: Status 404 returned error can't find the container with id 98c8614919e4d46a000bd440e2f90d2e206b9f2f94bb263eddefe98c1d95c4a2
Sep 08 00:54:10.379410 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.379365    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:10.379506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.379455    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:10.379552 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.379505    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:10.432040 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:10.431985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" event={"ID":"4dc9d80e-7203-4996-89e3-5974f1e216d9","Type":"ContainerStarted","Data":"98c8614919e4d46a000bd440e2f90d2e206b9f2f94bb263eddefe98c1d95c4a2"}
Sep 08 00:54:11.440035 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:11.439995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" event={"ID":"4dc9d80e-7203-4996-89e3-5974f1e216d9","Type":"ContainerStarted","Data":"d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"}
Sep 08 00:54:11.460372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:11.460327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podStartSLOduration=2.460314657 podStartE2EDuration="2.460314657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:54:11.458236402 +0000 UTC m=+1273.836609835" watchObservedRunningTime="2026-09-08 00:54:11.460314657 +0000 UTC m=+1273.838688090"
Sep 08 00:54:12.085051 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:12.085019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:12.090503 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:12.090475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:12.445479 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:12.445379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:12.446347 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:12.446328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:13.072036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:13.072003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:13.325325 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:13.325238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:13.421597 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:13.421564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:14.574550 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:14.574513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:14.642139 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:14.642107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:14.978258 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:14.978157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:15.078950 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:15.078912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:15.145247 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:15.145217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:36.595213 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:36.595177    2578 generic.go:356] "Generic (PLEG): container finished" podID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerID="d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3" exitCode=0
Sep 08 00:54:36.595615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:36.595249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" event={"ID":"4dc9d80e-7203-4996-89e3-5974f1e216d9","Type":"ContainerDied","Data":"d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"}
Sep 08 00:54:36.595668 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:36.595660    2578 scope.go:117] "RemoveContainer" containerID="d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"
Sep 08 00:54:36.596985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:36.596958    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:36.597061 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:36.597027    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:36.597101 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:36.597068    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:54:37.606761 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:37.606727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" event={"ID":"4dc9d80e-7203-4996-89e3-5974f1e216d9","Type":"ContainerStarted","Data":"c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1"}
Sep 08 00:54:38.084726 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:38.084697    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:38.086094 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:38.086062    2578 patch_prober.go:28] interesting pod/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:54:38.086321 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:38.086282    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 00:54:38.234486 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:38.234449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:39.084845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:39.084810    2578 patch_prober.go:28] interesting pod/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:54:39.085428 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:39.085387    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 00:54:40.085131 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:40.085091    2578 patch_prober.go:28] interesting pod/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:54:40.085608 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:40.085156    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 00:54:41.052298 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:41.052260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:41.088007 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:41.087975    2578 patch_prober.go:28] interesting pod/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:54:41.088530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:41.088502    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 00:54:41.708747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:41.708709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:42.084944 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:42.084901    2578 patch_prober.go:28] interesting pod/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:54:42.085143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:42.084968    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 08 00:54:42.445845 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:42.445748    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:42.502574 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:42.502482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:43.223899 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:43.223864    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:43.226217 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:43.226193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:54:43.246078 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:43.246045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:47.063797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:47.063757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:51.165842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:51.165807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:53.234306 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:53.234258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:53.904398 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:53.904348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:54.004553 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:54.004516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:54.101897 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:54.101865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:54.162874 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:54.162788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:54.463128 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:54.463046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:56.775814 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:56.775767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:56.802140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:56.802107    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"]
Sep 08 00:54:56.802382 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:56.802356    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv" podUID="bab836ea-9fe2-4559-9a94-460a7a16062f" containerName="payload-pre-processing" containerID="cri-o://e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b" gracePeriod=30
Sep 08 00:54:56.876932 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:56.876898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:56.940286 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:56.940218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:56.996223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:56.996142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:57.082446 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.082291    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:54:57.228497 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.228470    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phk4j\" (UniqueName: \"kubernetes.io/projected/bab836ea-9fe2-4559-9a94-460a7a16062f-kube-api-access-phk4j\") pod \"bab836ea-9fe2-4559-9a94-460a7a16062f\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") "
Sep 08 00:54:57.228713 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.228554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab836ea-9fe2-4559-9a94-460a7a16062f-plugins-config-volume\") pod \"bab836ea-9fe2-4559-9a94-460a7a16062f\" (UID: \"bab836ea-9fe2-4559-9a94-460a7a16062f\") "
Sep 08 00:54:57.229003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.228981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bab836ea-9fe2-4559-9a94-460a7a16062f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bab836ea-9fe2-4559-9a94-460a7a16062f" (UID: "bab836ea-9fe2-4559-9a94-460a7a16062f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:54:57.230615 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.230582    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bab836ea-9fe2-4559-9a94-460a7a16062f-kube-api-access-phk4j" (OuterVolumeSpecName: "kube-api-access-phk4j") pod "bab836ea-9fe2-4559-9a94-460a7a16062f" (UID: "bab836ea-9fe2-4559-9a94-460a7a16062f"). InnerVolumeSpecName "kube-api-access-phk4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:54:57.276998 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.276912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:54:57.329498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.329441    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab836ea-9fe2-4559-9a94-460a7a16062f-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:54:57.329498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.329462    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phk4j\" (UniqueName: \"kubernetes.io/projected/bab836ea-9fe2-4559-9a94-460a7a16062f-kube-api-access-phk4j\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:54:57.737248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.737157    2578 generic.go:356] "Generic (PLEG): container finished" podID="bab836ea-9fe2-4559-9a94-460a7a16062f" containerID="e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b" exitCode=0
Sep 08 00:54:57.737248 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.737208    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"
Sep 08 00:54:57.737479 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.737239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv" event={"ID":"bab836ea-9fe2-4559-9a94-460a7a16062f","Type":"ContainerDied","Data":"e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b"}
Sep 08 00:54:57.737479 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.737321    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv" event={"ID":"bab836ea-9fe2-4559-9a94-460a7a16062f","Type":"ContainerDied","Data":"5d24c74355277c2284d63987e528bd8e8b4b5389c85eae12cbb0f2a405cd2337"}
Sep 08 00:54:57.737479 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.737354    2578 scope.go:117] "RemoveContainer" containerID="e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b"
Sep 08 00:54:57.746812 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.746797    2578 scope.go:117] "RemoveContainer" containerID="e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b"
Sep 08 00:54:57.747070 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:54:57.747052    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b\": container with ID starting with e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b not found: ID does not exist" containerID="e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b"
Sep 08 00:54:57.747125 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.747077    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b"} err="failed to get container status \"e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b\": rpc error: code = NotFound desc = could not find container \"e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b\": container with ID starting with e54775fdf9569693affcc5169bfad5274217861a0da9c22160698352b8e73d8b not found: ID does not exist"
Sep 08 00:54:57.760328 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.760307    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"]
Sep 08 00:54:57.764611 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:57.764593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-55b1e9-6bb99544c4-lggcv"]
Sep 08 00:54:58.058647 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:58.058618    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bab836ea-9fe2-4559-9a94-460a7a16062f" path="/var/lib/kubelet/pods/bab836ea-9fe2-4559-9a94-460a7a16062f/volumes"
Sep 08 00:54:59.489747 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:54:59.489709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:02.950415 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:02.950376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:03.050993 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:03.050952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:03.175149 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:03.175116    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"]
Sep 08 00:55:03.175419 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:03.175368    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy" containerID="cri-o://b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961" gracePeriod=30
Sep 08 00:55:03.217461 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:03.217388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:03.886812 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:03.886773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:08.440151 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.440092    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:55:08.533214 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533183    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-credential-socket\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052ac600-556c-4cdb-9233-0332e68cf9d3-istiod-ca-cert\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533261    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-certs\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533294    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4lzl\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-kube-api-access-n4lzl\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533355 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-token\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533358    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-socket\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533389    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-podinfo\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-envoy\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:08.533563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533476    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-data\") pod \"052ac600-556c-4cdb-9233-0332e68cf9d3\" (UID: \"052ac600-556c-4cdb-9233-0332e68cf9d3\") "
Sep 08 00:55:08.533563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533538    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:08.533898 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533767    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:08.533898 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533785    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:08.533898 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533829    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/052ac600-556c-4cdb-9233-0332e68cf9d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:08.534055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.533989    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.534055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.534007    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.534055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.534024    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.534055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.534037    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.534055 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.534050    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052ac600-556c-4cdb-9233-0332e68cf9d3-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.535517 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.535489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:08.535636 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.535562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-kube-api-access-n4lzl" (OuterVolumeSpecName: "kube-api-access-n4lzl") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "kube-api-access-n4lzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:08.536022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.535993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:55:08.536022 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.536003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "052ac600-556c-4cdb-9233-0332e68cf9d3" (UID: "052ac600-556c-4cdb-9233-0332e68cf9d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:08.635223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.635200    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4lzl\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-kube-api-access-n4lzl\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.635223 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.635223    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.635372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.635232    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.635372 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.635240    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052ac600-556c-4cdb-9233-0332e68cf9d3-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:08.812004 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.811976    2578 generic.go:356] "Generic (PLEG): container finished" podID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerID="b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961" exitCode=0
Sep 08 00:55:08.812129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.812024    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"
Sep 08 00:55:08.812129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.812050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" event={"ID":"052ac600-556c-4cdb-9233-0332e68cf9d3","Type":"ContainerDied","Data":"b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961"}
Sep 08 00:55:08.812129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.812095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd" event={"ID":"052ac600-556c-4cdb-9233-0332e68cf9d3","Type":"ContainerDied","Data":"a0fd9ab732b38fd42b49bd0ebd3e191ab17f74655709a6f9fb6bbcede0cf083e"}
Sep 08 00:55:08.812129 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.812122    2578 scope.go:117] "RemoveContainer" containerID="b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961"
Sep 08 00:55:08.821785 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.821765    2578 scope.go:117] "RemoveContainer" containerID="da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"
Sep 08 00:55:08.829762 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.829744    2578 scope.go:117] "RemoveContainer" containerID="b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961"
Sep 08 00:55:08.830016 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:08.830002    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961\": container with ID starting with b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961 not found: ID does not exist" containerID="b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961"
Sep 08 00:55:08.830069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.830023    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961"} err="failed to get container status \"b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961\": rpc error: code = NotFound desc = could not find container \"b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961\": container with ID starting with b3861c065560d7ad55b0e70e2b5a5e1c3fd458b45715afca708b648bc389d961 not found: ID does not exist"
Sep 08 00:55:08.830069 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.830038    2578 scope.go:117] "RemoveContainer" containerID="da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"
Sep 08 00:55:08.830344 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:08.830316    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361\": container with ID starting with da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361 not found: ID does not exist" containerID="da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"
Sep 08 00:55:08.830405 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.830342    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361"} err="failed to get container status \"da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361\": rpc error: code = NotFound desc = could not find container \"da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361\": container with ID starting with da9e729004aa2975c201c975d25c7787444dfb2569d52726221c24fec6600361 not found: ID does not exist"
Sep 08 00:55:08.833768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.833750    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"]
Sep 08 00:55:08.839180 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:08.839159    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-55b1e9-openshift-default-cbbd97db-q4nqd"]
Sep 08 00:55:10.058597 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:10.058565    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" path="/var/lib/kubelet/pods/052ac600-556c-4cdb-9233-0332e68cf9d3/volumes"
Sep 08 00:55:19.002946 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:19.002907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:19.074025 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:19.073937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:19.137548 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:19.137494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:19.204156 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:19.204123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:19.260363 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:19.260289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:19.558996 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:19.558941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:25.196274 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:25.196189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:25.299510 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:25.299468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:25.427113 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:25.427081    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"]
Sep 08 00:55:25.427331 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:25.427303    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" containerID="cri-o://c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1" gracePeriod=30
Sep 08 00:55:25.441827 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:25.441799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:25.845174 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:25.845131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:28.227160 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:28.227131    2578 patch_prober.go:28] interesting pod/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:55:28.227512 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:28.227187    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:55:30.690137 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.690078    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:55:30.840268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840229    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dc9d80e-7203-4996-89e3-5974f1e216d9-istiod-ca-cert\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840268 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-token\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840316    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-data\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840380    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-socket\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840413    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-certs\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840473 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-envoy\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840715 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840502    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-778t7\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-kube-api-access-778t7\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840715 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-credential-socket\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840715 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840555    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc9d80e-7203-4996-89e3-5974f1e216d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:30.840715 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840566    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-podinfo\") pod \"4dc9d80e-7203-4996-89e3-5974f1e216d9\" (UID: \"4dc9d80e-7203-4996-89e3-5974f1e216d9\") "
Sep 08 00:55:30.840715 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:30.840985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:30.840985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840803    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:30.840985 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.840963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:30.841128 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.841110    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.841172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.841134    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dc9d80e-7203-4996-89e3-5974f1e216d9-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.841172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.841150    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.841172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.841163    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.841291 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.841176    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.842623 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.842591    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:55:30.842760 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.842695    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:30.842912 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.842895    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:30.842972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.842950    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-kube-api-access-778t7" (OuterVolumeSpecName: "kube-api-access-778t7") pod "4dc9d80e-7203-4996-89e3-5974f1e216d9" (UID: "4dc9d80e-7203-4996-89e3-5974f1e216d9"). InnerVolumeSpecName "kube-api-access-778t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:30.942469 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.942403    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.942469 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.942427    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.942469 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.942439    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-778t7\" (UniqueName: \"kubernetes.io/projected/4dc9d80e-7203-4996-89e3-5974f1e216d9-kube-api-access-778t7\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.942469 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.942452    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dc9d80e-7203-4996-89e3-5974f1e216d9-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:30.951700 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.951660    2578 generic.go:356] "Generic (PLEG): container finished" podID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerID="c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1" exitCode=0
Sep 08 00:55:30.951797 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.951726    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"
Sep 08 00:55:30.951858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.951723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" event={"ID":"4dc9d80e-7203-4996-89e3-5974f1e216d9","Type":"ContainerDied","Data":"c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1"}
Sep 08 00:55:30.951906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.951867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z" event={"ID":"4dc9d80e-7203-4996-89e3-5974f1e216d9","Type":"ContainerDied","Data":"98c8614919e4d46a000bd440e2f90d2e206b9f2f94bb263eddefe98c1d95c4a2"}
Sep 08 00:55:30.951906 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.951882    2578 scope.go:117] "RemoveContainer" containerID="c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1"
Sep 08 00:55:30.961638 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.961614    2578 scope.go:117] "RemoveContainer" containerID="d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"
Sep 08 00:55:30.969768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.969753    2578 scope.go:117] "RemoveContainer" containerID="c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1"
Sep 08 00:55:30.970029 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:30.970009    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1\": container with ID starting with c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1 not found: ID does not exist" containerID="c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1"
Sep 08 00:55:30.970079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.970037    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1"} err="failed to get container status \"c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1\": rpc error: code = NotFound desc = could not find container \"c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1\": container with ID starting with c3247f58a2a7f32962972bae8121741a09725ec20ea86cb059417c7ac722c9a1 not found: ID does not exist"
Sep 08 00:55:30.970079 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.970053    2578 scope.go:117] "RemoveContainer" containerID="d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"
Sep 08 00:55:30.970322 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:30.970306    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3\": container with ID starting with d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3 not found: ID does not exist" containerID="d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"
Sep 08 00:55:30.970366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.970327    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3"} err="failed to get container status \"d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3\": rpc error: code = NotFound desc = could not find container \"d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3\": container with ID starting with d28273d62f1581a90eb1804f1e41358a18e3035e10b0fdab31d5d48126f42da3 not found: ID does not exist"
Sep 08 00:55:30.974443 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.974420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"]
Sep 08 00:55:30.978652 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:30.978632    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3e8800-openshift-default-55d9475b98-z8q6z"]
Sep 08 00:55:32.058430 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:32.058397    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" path="/var/lib/kubelet/pods/4dc9d80e-7203-4996-89e3-5974f1e216d9/volumes"
Sep 08 00:55:35.835311 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:35.835277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:36.370444 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.370301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:36.386034 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.386005    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"]
Sep 08 00:55:36.386253 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.386227    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv" podUID="a1b847d3-9f33-400e-971e-aef8bb394a51" containerName="maas-api" containerID="cri-o://5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487" gracePeriod=30
Sep 08 00:55:36.497796 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.497716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:36.513018 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.512955    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"]
Sep 08 00:55:36.513379 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.513207    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff" podUID="de07df94-e4e8-49e7-9ed3-b9bda5778e0b" containerName="payload-pre-processing" containerID="cri-o://807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6" gracePeriod=30
Sep 08 00:55:36.594921 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.594887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:36.665424 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.665394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:36.674474 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.674445    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:55:36.723879 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.723838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:36.786439 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.786414    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:55:36.796036 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.796005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-metrics-certs\") pod \"a1b847d3-9f33-400e-971e-aef8bb394a51\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") "
Sep 08 00:55:36.796153 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.796101    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w7sp\" (UniqueName: \"kubernetes.io/projected/a1b847d3-9f33-400e-971e-aef8bb394a51-kube-api-access-4w7sp\") pod \"a1b847d3-9f33-400e-971e-aef8bb394a51\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") "
Sep 08 00:55:36.796153 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.796129    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b847d3-9f33-400e-971e-aef8bb394a51-openshift-service-ca\") pod \"a1b847d3-9f33-400e-971e-aef8bb394a51\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") "
Sep 08 00:55:36.796274 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.796173    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-maas-api-tls\") pod \"a1b847d3-9f33-400e-971e-aef8bb394a51\" (UID: \"a1b847d3-9f33-400e-971e-aef8bb394a51\") "
Sep 08 00:55:36.796520 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.796491    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b847d3-9f33-400e-971e-aef8bb394a51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1b847d3-9f33-400e-971e-aef8bb394a51" (UID: "a1b847d3-9f33-400e-971e-aef8bb394a51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:36.796639 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.796620    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b847d3-9f33-400e-971e-aef8bb394a51-openshift-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:36.798215 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.798187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1b847d3-9f33-400e-971e-aef8bb394a51" (UID: "a1b847d3-9f33-400e-971e-aef8bb394a51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:55:36.798489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.798466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b847d3-9f33-400e-971e-aef8bb394a51-kube-api-access-4w7sp" (OuterVolumeSpecName: "kube-api-access-4w7sp") pod "a1b847d3-9f33-400e-971e-aef8bb394a51" (UID: "a1b847d3-9f33-400e-971e-aef8bb394a51"). InnerVolumeSpecName "kube-api-access-4w7sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:36.798489 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.798471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a1b847d3-9f33-400e-971e-aef8bb394a51" (UID: "a1b847d3-9f33-400e-971e-aef8bb394a51"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:55:36.897040 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.897007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbjcc\" (UniqueName: \"kubernetes.io/projected/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-kube-api-access-fbjcc\") pod \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") "
Sep 08 00:55:36.897498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.897118    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-plugins-config-volume\") pod \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\" (UID: \"de07df94-e4e8-49e7-9ed3-b9bda5778e0b\") "
Sep 08 00:55:36.897498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.897316    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-metrics-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:36.897498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.897327    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w7sp\" (UniqueName: \"kubernetes.io/projected/a1b847d3-9f33-400e-971e-aef8bb394a51-kube-api-access-4w7sp\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:36.897498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.897337    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b847d3-9f33-400e-971e-aef8bb394a51-maas-api-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:36.897498 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.897434    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de07df94-e4e8-49e7-9ed3-b9bda5778e0b" (UID: "de07df94-e4e8-49e7-9ed3-b9bda5778e0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:36.899153 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.899131    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-kube-api-access-fbjcc" (OuterVolumeSpecName: "kube-api-access-fbjcc") pod "de07df94-e4e8-49e7-9ed3-b9bda5778e0b" (UID: "de07df94-e4e8-49e7-9ed3-b9bda5778e0b"). InnerVolumeSpecName "kube-api-access-fbjcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:36.996003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.995977    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1b847d3-9f33-400e-971e-aef8bb394a51" containerID="5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487" exitCode=0
Sep 08 00:55:36.996155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.996024    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"
Sep 08 00:55:36.996155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.996058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv" event={"ID":"a1b847d3-9f33-400e-971e-aef8bb394a51","Type":"ContainerDied","Data":"5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487"}
Sep 08 00:55:36.996155 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.996127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv" event={"ID":"a1b847d3-9f33-400e-971e-aef8bb394a51","Type":"ContainerDied","Data":"6822e01e6410c0bd75c104a652a7ef1985948c8870b2849b94290176743f7c60"}
Sep 08 00:55:36.996317 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.996158    2578 scope.go:117] "RemoveContainer" containerID="5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487"
Sep 08 00:55:36.997938 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.997910    2578 generic.go:356] "Generic (PLEG): container finished" podID="de07df94-e4e8-49e7-9ed3-b9bda5778e0b" containerID="807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6" exitCode=0
Sep 08 00:55:36.998073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.997952    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"
Sep 08 00:55:36.998073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.997990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff" event={"ID":"de07df94-e4e8-49e7-9ed3-b9bda5778e0b","Type":"ContainerDied","Data":"807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6"}
Sep 08 00:55:36.998073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.998052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff" event={"ID":"de07df94-e4e8-49e7-9ed3-b9bda5778e0b","Type":"ContainerDied","Data":"b6e497aa9b402ea6f64638ef9d6c02989b73e5c4aaafd82ce46c0551c2b09759"}
Sep 08 00:55:36.998073 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.997997    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:36.998283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:36.998140    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbjcc\" (UniqueName: \"kubernetes.io/projected/de07df94-e4e8-49e7-9ed3-b9bda5778e0b-kube-api-access-fbjcc\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:37.006941 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.006922    2578 scope.go:117] "RemoveContainer" containerID="5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487"
Sep 08 00:55:37.007227 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:37.007208    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487\": container with ID starting with 5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487 not found: ID does not exist" containerID="5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487"
Sep 08 00:55:37.007301 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.007234    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487"} err="failed to get container status \"5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487\": rpc error: code = NotFound desc = could not find container \"5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487\": container with ID starting with 5568a249f4c62959ae079272ced33ea5df69cd83c42dc83b8f456375a2326487 not found: ID does not exist"
Sep 08 00:55:37.007301 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.007250    2578 scope.go:117] "RemoveContainer" containerID="807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6"
Sep 08 00:55:37.012348 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.012310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:37.015338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.015323    2578 scope.go:117] "RemoveContainer" containerID="807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6"
Sep 08 00:55:37.015589 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:37.015572    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6\": container with ID starting with 807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6 not found: ID does not exist" containerID="807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6"
Sep 08 00:55:37.015630 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.015595    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6"} err="failed to get container status \"807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6\": rpc error: code = NotFound desc = could not find container \"807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6\": container with ID starting with 807d90389ea3f896f599d196f5e429b0258217cf73afd77be8f3036e937b95c6 not found: ID does not exist"
Sep 08 00:55:37.022178 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.022134    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"]
Sep 08 00:55:37.028274 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.028249    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c99af4-9c9555758-d4xgv"]
Sep 08 00:55:37.040140 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.040118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"]
Sep 08 00:55:37.044434 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.044416    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c99af4-5d864c85f8-r9tff"]
Sep 08 00:55:37.263857 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:37.263819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:38.057464 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:38.057433    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b847d3-9f33-400e-971e-aef8bb394a51" path="/var/lib/kubelet/pods/a1b847d3-9f33-400e-971e-aef8bb394a51/volumes"
Sep 08 00:55:38.057839 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:38.057791    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de07df94-e4e8-49e7-9ed3-b9bda5778e0b" path="/var/lib/kubelet/pods/de07df94-e4e8-49e7-9ed3-b9bda5778e0b/volumes"
Sep 08 00:55:42.789628 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:42.789585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:42.893732 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:42.893623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:43.019858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:43.019815    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"]
Sep 08 00:55:43.020496 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:43.020462    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" containerID="cri-o://2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20" gracePeriod=30
Sep 08 00:55:43.037854 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:43.036262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:43.451282 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:43.451251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:43.775697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:43.775589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:43.908591 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:43.908560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:44.038071 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:44.037972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:44.712283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:44.712249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:45.635568 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:45.635529    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:55:45.635961 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:45.635593    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:55:48.273181 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.273159    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:55:48.299283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-token\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299423 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299289    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b2daee3-e01e-4d6c-842e-400b65d90649-istiod-ca-cert\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299423 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-socket\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299423 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299409    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-podinfo\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299455    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-envoy\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299478    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-data\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-credential-socket\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299595 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299525    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-certs\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bh6k\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-kube-api-access-7bh6k\") pod \"1b2daee3-e01e-4d6c-842e-400b65d90649\" (UID: \"1b2daee3-e01e-4d6c-842e-400b65d90649\") "
Sep 08 00:55:48.299861 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.299731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2daee3-e01e-4d6c-842e-400b65d90649-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:48.300303 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.300107    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b2daee3-e01e-4d6c-842e-400b65d90649-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.300427 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.300338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:48.300502 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.300421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:48.300642 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.300607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:48.300988 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.300967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:48.301820 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.301796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:48.302232 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.302201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-kube-api-access-7bh6k" (OuterVolumeSpecName: "kube-api-access-7bh6k") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "kube-api-access-7bh6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:48.302384 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.302353    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:55:48.302655 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.302631    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b2daee3-e01e-4d6c-842e-400b65d90649" (UID: "1b2daee3-e01e-4d6c-842e-400b65d90649"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:55:48.401135 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401110    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bh6k\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-kube-api-access-7bh6k\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401135 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401134    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401143    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401152    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401161    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401169    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401177    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:48.401271 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:48.401185    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b2daee3-e01e-4d6c-842e-400b65d90649-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:49.091421 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.091385    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerID="2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20" exitCode=0
Sep 08 00:55:49.091586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.091432    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"
Sep 08 00:55:49.091586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.091472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" event={"ID":"1b2daee3-e01e-4d6c-842e-400b65d90649","Type":"ContainerDied","Data":"2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20"}
Sep 08 00:55:49.091586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.091524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh" event={"ID":"1b2daee3-e01e-4d6c-842e-400b65d90649","Type":"ContainerDied","Data":"bd499ec8ab17651f572c875a028a25dda4d68a70c40eaded87eb3f1a98ab52df"}
Sep 08 00:55:49.091586 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.091546    2578 scope.go:117] "RemoveContainer" containerID="2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20"
Sep 08 00:55:49.104417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.104401    2578 scope.go:117] "RemoveContainer" containerID="a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"
Sep 08 00:55:49.114020 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.114002    2578 scope.go:117] "RemoveContainer" containerID="2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20"
Sep 08 00:55:49.114314 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:49.114292    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20\": container with ID starting with 2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20 not found: ID does not exist" containerID="2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20"
Sep 08 00:55:49.114388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.114323    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20"} err="failed to get container status \"2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20\": rpc error: code = NotFound desc = could not find container \"2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20\": container with ID starting with 2a0d87fdefc100bb27daa37f01da749e9e9999e95204de86e27527581a3e9d20 not found: ID does not exist"
Sep 08 00:55:49.114388 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.114341    2578 scope.go:117] "RemoveContainer" containerID="a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"
Sep 08 00:55:49.114506 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.114470    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"]
Sep 08 00:55:49.114624 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:49.114607    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc\": container with ID starting with a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc not found: ID does not exist" containerID="a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"
Sep 08 00:55:49.114664 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.114631    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc"} err="failed to get container status \"a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc\": rpc error: code = NotFound desc = could not find container \"a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc\": container with ID starting with a7f50115750a5bcd580de282401ca6082143ec2c767fd0d3b39b54c8c362dcfc not found: ID does not exist"
Sep 08 00:55:49.118143 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:49.118121    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c99af4-openshift-default-6d9f767c54-2w2lh"]
Sep 08 00:55:50.057750 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:50.057720    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" path="/var/lib/kubelet/pods/1b2daee3-e01e-4d6c-842e-400b65d90649/volumes"
Sep 08 00:55:53.473012 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:53.472967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:54.145757 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.145708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:54.190442 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.190407    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"]
Sep 08 00:55:54.190922 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.190890    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7" podUID="53a1d003-0554-4a70-b593-db9433018f2e" containerName="payload-processing" containerID="cri-o://685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df" gracePeriod=30
Sep 08 00:55:54.192975 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.192953    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"]
Sep 08 00:55:54.193170 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.193141    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf" podUID="00b62b3b-291b-4952-868d-cc8fe4a49415" containerName="payload-pre-processing" containerID="cri-o://66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552" gracePeriod=30
Sep 08 00:55:54.251928 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.251898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:54.354485 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.354450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:54.447345 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.447317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:54.449283 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.449262    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:55:54.479057 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.479035    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:55:54.555898 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.555871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b62b3b-291b-4952-868d-cc8fe4a49415-plugins-config-volume\") pod \"00b62b3b-291b-4952-868d-cc8fe4a49415\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") "
Sep 08 00:55:54.556049 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.555953    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8dph\" (UniqueName: \"kubernetes.io/projected/53a1d003-0554-4a70-b593-db9433018f2e-kube-api-access-l8dph\") pod \"53a1d003-0554-4a70-b593-db9433018f2e\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") "
Sep 08 00:55:54.556049 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.556010    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a1d003-0554-4a70-b593-db9433018f2e-plugins-config-volume\") pod \"53a1d003-0554-4a70-b593-db9433018f2e\" (UID: \"53a1d003-0554-4a70-b593-db9433018f2e\") "
Sep 08 00:55:54.556149 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.556049    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnd8j\" (UniqueName: \"kubernetes.io/projected/00b62b3b-291b-4952-868d-cc8fe4a49415-kube-api-access-qnd8j\") pod \"00b62b3b-291b-4952-868d-cc8fe4a49415\" (UID: \"00b62b3b-291b-4952-868d-cc8fe4a49415\") "
Sep 08 00:55:54.556400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.556365    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b62b3b-291b-4952-868d-cc8fe4a49415-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00b62b3b-291b-4952-868d-cc8fe4a49415" (UID: "00b62b3b-291b-4952-868d-cc8fe4a49415"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:54.556400 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.556386    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a1d003-0554-4a70-b593-db9433018f2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53a1d003-0554-4a70-b593-db9433018f2e" (UID: "53a1d003-0554-4a70-b593-db9433018f2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:54.558171 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.558149    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b62b3b-291b-4952-868d-cc8fe4a49415-kube-api-access-qnd8j" (OuterVolumeSpecName: "kube-api-access-qnd8j") pod "00b62b3b-291b-4952-868d-cc8fe4a49415" (UID: "00b62b3b-291b-4952-868d-cc8fe4a49415"). InnerVolumeSpecName "kube-api-access-qnd8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:54.558266 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.558184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a1d003-0554-4a70-b593-db9433018f2e-kube-api-access-l8dph" (OuterVolumeSpecName: "kube-api-access-l8dph") pod "53a1d003-0554-4a70-b593-db9433018f2e" (UID: "53a1d003-0554-4a70-b593-db9433018f2e"). InnerVolumeSpecName "kube-api-access-l8dph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:54.657969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.657904    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8dph\" (UniqueName: \"kubernetes.io/projected/53a1d003-0554-4a70-b593-db9433018f2e-kube-api-access-l8dph\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:54.657969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.657933    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53a1d003-0554-4a70-b593-db9433018f2e-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:54.657969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.657946    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnd8j\" (UniqueName: \"kubernetes.io/projected/00b62b3b-291b-4952-868d-cc8fe4a49415-kube-api-access-qnd8j\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:54.657969 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.657959    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b62b3b-291b-4952-868d-cc8fe4a49415-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:54.667768 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.667734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:54.769021 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:54.768986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:55.129816 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.129780    2578 generic.go:356] "Generic (PLEG): container finished" podID="00b62b3b-291b-4952-868d-cc8fe4a49415" containerID="66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552" exitCode=0
Sep 08 00:55:55.129972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.129822    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"
Sep 08 00:55:55.129972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.129861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf" event={"ID":"00b62b3b-291b-4952-868d-cc8fe4a49415","Type":"ContainerDied","Data":"66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552"}
Sep 08 00:55:55.129972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.129906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf" event={"ID":"00b62b3b-291b-4952-868d-cc8fe4a49415","Type":"ContainerDied","Data":"03f6a594513c7673c360f10d0c4a6f1ca0a0f6784a6e341efbf2ff00361f6d9d"}
Sep 08 00:55:55.129972 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.129928    2578 scope.go:117] "RemoveContainer" containerID="66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552"
Sep 08 00:55:55.131326 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.131303    2578 generic.go:356] "Generic (PLEG): container finished" podID="53a1d003-0554-4a70-b593-db9433018f2e" containerID="685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df" exitCode=0
Sep 08 00:55:55.131429 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.131353    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"
Sep 08 00:55:55.131429 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.131383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7" event={"ID":"53a1d003-0554-4a70-b593-db9433018f2e","Type":"ContainerDied","Data":"685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df"}
Sep 08 00:55:55.131530 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.131428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7" event={"ID":"53a1d003-0554-4a70-b593-db9433018f2e","Type":"ContainerDied","Data":"f66e9755cd8e7a4fc2e2c97a6b1292e9552f2b10c3a3fa853d71cadc94178ab7"}
Sep 08 00:55:55.140831 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.140812    2578 scope.go:117] "RemoveContainer" containerID="66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552"
Sep 08 00:55:55.141108 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:55.141086    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552\": container with ID starting with 66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552 not found: ID does not exist" containerID="66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552"
Sep 08 00:55:55.141172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.141113    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552"} err="failed to get container status \"66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552\": rpc error: code = NotFound desc = could not find container \"66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552\": container with ID starting with 66c2aaf87d755bd56f48309637b8fe255ad57532192702a698b144e43d240552 not found: ID does not exist"
Sep 08 00:55:55.141172 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.141132    2578 scope.go:117] "RemoveContainer" containerID="685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df"
Sep 08 00:55:55.148911 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.148895    2578 scope.go:117] "RemoveContainer" containerID="685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df"
Sep 08 00:55:55.149229 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:55.149198    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df\": container with ID starting with 685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df not found: ID does not exist" containerID="685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df"
Sep 08 00:55:55.149336 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.149234    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df"} err="failed to get container status \"685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df\": rpc error: code = NotFound desc = could not find container \"685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df\": container with ID starting with 685284c45e9f74f227c70bd03b61ef90cd1c2c102218b19c60afc17e4dd203df not found: ID does not exist"
Sep 08 00:55:55.152006 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.151989    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"]
Sep 08 00:55:55.162563 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.162539    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f04ef7-6b5f8b8ff8-8jlwf"]
Sep 08 00:55:55.184352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.184334    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"]
Sep 08 00:55:55.190003 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.189983    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f04ef7-cc58ff779-m9fv7"]
Sep 08 00:55:55.286553 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.286526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:55.355522 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.355491    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"]
Sep 08 00:55:55.355766 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.355738    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp" podUID="4d585b1a-e1a1-49af-8e33-4fff104530cd" containerName="payload-pre-processing" containerID="cri-o://16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542" gracePeriod=30
Sep 08 00:55:55.379331 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.373699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:55.475074 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.475040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:55.532131 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.532101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:55.616525 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.616500    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:55:55.667387 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.667287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d585b1a-e1a1-49af-8e33-4fff104530cd-plugins-config-volume\") pod \"4d585b1a-e1a1-49af-8e33-4fff104530cd\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") "
Sep 08 00:55:55.667599 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.667419    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfvs6\" (UniqueName: \"kubernetes.io/projected/4d585b1a-e1a1-49af-8e33-4fff104530cd-kube-api-access-pfvs6\") pod \"4d585b1a-e1a1-49af-8e33-4fff104530cd\" (UID: \"4d585b1a-e1a1-49af-8e33-4fff104530cd\") "
Sep 08 00:55:55.668670 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.668640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d585b1a-e1a1-49af-8e33-4fff104530cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d585b1a-e1a1-49af-8e33-4fff104530cd" (UID: "4d585b1a-e1a1-49af-8e33-4fff104530cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:55:55.670059 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.670022    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d585b1a-e1a1-49af-8e33-4fff104530cd-kube-api-access-pfvs6" (OuterVolumeSpecName: "kube-api-access-pfvs6") pod "4d585b1a-e1a1-49af-8e33-4fff104530cd" (UID: "4d585b1a-e1a1-49af-8e33-4fff104530cd"). InnerVolumeSpecName "kube-api-access-pfvs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:55:55.769060 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.769035    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfvs6\" (UniqueName: \"kubernetes.io/projected/4d585b1a-e1a1-49af-8e33-4fff104530cd-kube-api-access-pfvs6\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:55.769060 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.769058    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d585b1a-e1a1-49af-8e33-4fff104530cd-plugins-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:55:55.845163 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:55.845134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:55:56.057842 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.057816    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b62b3b-291b-4952-868d-cc8fe4a49415" path="/var/lib/kubelet/pods/00b62b3b-291b-4952-868d-cc8fe4a49415/volumes"
Sep 08 00:55:56.058203 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.058189    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53a1d003-0554-4a70-b593-db9433018f2e" path="/var/lib/kubelet/pods/53a1d003-0554-4a70-b593-db9433018f2e/volumes"
Sep 08 00:55:56.139056 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.139030    2578 generic.go:356] "Generic (PLEG): container finished" podID="4d585b1a-e1a1-49af-8e33-4fff104530cd" containerID="16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542" exitCode=0
Sep 08 00:55:56.139204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.139081    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"
Sep 08 00:55:56.139204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.139122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp" event={"ID":"4d585b1a-e1a1-49af-8e33-4fff104530cd","Type":"ContainerDied","Data":"16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542"}
Sep 08 00:55:56.139204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.139171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp" event={"ID":"4d585b1a-e1a1-49af-8e33-4fff104530cd","Type":"ContainerDied","Data":"8447a57b9ba977f0e7720f5f8025c01eb60182c4d7b8b294fa23ab324a5dc909"}
Sep 08 00:55:56.139204 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.139201    2578 scope.go:117] "RemoveContainer" containerID="16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542"
Sep 08 00:55:56.147832 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.147792    2578 scope.go:117] "RemoveContainer" containerID="16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542"
Sep 08 00:55:56.148068 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:55:56.148048    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542\": container with ID starting with 16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542 not found: ID does not exist" containerID="16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542"
Sep 08 00:55:56.148116 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.148074    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542"} err="failed to get container status \"16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542\": rpc error: code = NotFound desc = could not find container \"16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542\": container with ID starting with 16b7632c10ea505d54ae8e3e3619f909cc716cfe23afab7d50042a928a3a4542 not found: ID does not exist"
Sep 08 00:55:56.155775 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.155751    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"]
Sep 08 00:55:56.162338 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:56.162318    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e810-566b956858-cwbnp"]
Sep 08 00:55:58.057968 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:55:58.057938    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d585b1a-e1a1-49af-8e33-4fff104530cd" path="/var/lib/kubelet/pods/4d585b1a-e1a1-49af-8e33-4fff104530cd/volumes"
Sep 08 00:56:00.557318 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:00.557286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:56:00.658614 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:00.658570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:56:00.791097 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:00.791065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:56:01.845883 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:01.845846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:56:01.907370 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:01.907327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:56:02.077878 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:02.077842    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"]
Sep 08 00:56:02.078112 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:02.078087    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" containerID="cri-o://81212be44251f32019232a22927c94ec8500374045496bd412aeceaba95117aa" gracePeriod=30
Sep 08 00:56:02.101790 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:02.101710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:56:06.423466 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:06.423428    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:56:06.423941 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:06.423497    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:56:07.211617 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.211589    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerID="81212be44251f32019232a22927c94ec8500374045496bd412aeceaba95117aa" exitCode=0
Sep 08 00:56:07.211778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.211692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" event={"ID":"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b","Type":"ContainerDied","Data":"81212be44251f32019232a22927c94ec8500374045496bd412aeceaba95117aa"}
Sep 08 00:56:07.211778 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.211770    2578 scope.go:117] "RemoveContainer" containerID="5c58db196874debe07b1b7bca7f9d5f909e4453aaa3c9b1bad6bc7c74c44896e"
Sep 08 00:56:07.356950 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.356898    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:56:07.482925 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.482882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-podinfo\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.482936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-envoy\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.482982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istiod-ca-cert\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-credential-socket\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483066    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6v66\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-kube-api-access-d6v66\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-data\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483162    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-token\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483202    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-certs\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483366 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-socket\") pod \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\" (UID: \"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b\") "
Sep 08 00:56:07.483864 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483657    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:56:07.483864 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483806    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:56:07.484367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.483971    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:56:07.484367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.484169    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:56:07.484367 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.484324    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:56:07.488138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.486092    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:56:07.488138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.486705    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:56:07.488138 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.487196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-kube-api-access-d6v66" (OuterVolumeSpecName: "kube-api-access-d6v66") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "kube-api-access-d6v66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:56:07.488501 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.488472    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" (UID: "4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:56:07.584697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584656    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-podinfo\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584677    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-envoy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584697 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584699    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istiod-ca-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584707    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-credential-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584717    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6v66\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-kube-api-access-d6v66\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584725    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-data\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584732    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584741    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:07.584930 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:07.584748    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b-workload-socket\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:56:08.217894 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:08.217863    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"
Sep 08 00:56:08.218044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:08.217870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw" event={"ID":"4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b","Type":"ContainerDied","Data":"17ee75a8d203584ec15be3f350175e0b5500530aa819f7f1e47f5fa8cc156a9b"}
Sep 08 00:56:08.218044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:08.217999    2578 scope.go:117] "RemoveContainer" containerID="81212be44251f32019232a22927c94ec8500374045496bd412aeceaba95117aa"
Sep 08 00:56:08.237187 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:08.237160    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"]
Sep 08 00:56:08.240076 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:08.240055    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-a8e810-openshift-default-689b49848-xhbsw"]
Sep 08 00:56:10.057899 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:56:10.057869    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" path="/var/lib/kubelet/pods/4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b/volumes"
Sep 08 00:57:27.991146 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:57:27.991113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:57:29.538417 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:57:29.538376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:57:31.029642 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:57:31.029606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:58:38.770177 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:58:38.770139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:58:45.152885 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:58:45.152847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 00:59:00.159573 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:00.159538    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"]
Sep 08 00:59:00.160011 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:00.159736    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb" podUID="9a39ea65-eecc-422c-897f-d155f8f1f71c" containerName="manager" containerID="cri-o://9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1" gracePeriod=10
Sep 08 00:59:02.915352 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:02.915328    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:59:03.034931 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.034854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9nd9\" (UniqueName: \"kubernetes.io/projected/9a39ea65-eecc-422c-897f-d155f8f1f71c-kube-api-access-g9nd9\") pod \"9a39ea65-eecc-422c-897f-d155f8f1f71c\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") "
Sep 08 00:59:03.034931 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.034931    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a39ea65-eecc-422c-897f-d155f8f1f71c-extensions-socket-volume\") pod \"9a39ea65-eecc-422c-897f-d155f8f1f71c\" (UID: \"9a39ea65-eecc-422c-897f-d155f8f1f71c\") "
Sep 08 00:59:03.035266 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.035241    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a39ea65-eecc-422c-897f-d155f8f1f71c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a39ea65-eecc-422c-897f-d155f8f1f71c" (UID: "9a39ea65-eecc-422c-897f-d155f8f1f71c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:59:03.036858 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.036834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a39ea65-eecc-422c-897f-d155f8f1f71c-kube-api-access-g9nd9" (OuterVolumeSpecName: "kube-api-access-g9nd9") pod "9a39ea65-eecc-422c-897f-d155f8f1f71c" (UID: "9a39ea65-eecc-422c-897f-d155f8f1f71c"). InnerVolumeSpecName "kube-api-access-g9nd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:59:03.136575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.136548    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a39ea65-eecc-422c-897f-d155f8f1f71c-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:59:03.136575 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.136573    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9nd9\" (UniqueName: \"kubernetes.io/projected/9a39ea65-eecc-422c-897f-d155f8f1f71c-kube-api-access-g9nd9\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 00:59:03.179857 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.179825    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a39ea65-eecc-422c-897f-d155f8f1f71c" containerID="9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1" exitCode=0
Sep 08 00:59:03.179963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.179870    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"
Sep 08 00:59:03.179963 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.179913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb" event={"ID":"9a39ea65-eecc-422c-897f-d155f8f1f71c","Type":"ContainerDied","Data":"9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1"}
Sep 08 00:59:03.180044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.179966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb" event={"ID":"9a39ea65-eecc-422c-897f-d155f8f1f71c","Type":"ContainerDied","Data":"e91cf0ce66d16e3dfed2e72697e3ed817006311ded20f593660d24f3a0b7d1b1"}
Sep 08 00:59:03.180044 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.179988    2578 scope.go:117] "RemoveContainer" containerID="9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1"
Sep 08 00:59:03.190166 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.190150    2578 scope.go:117] "RemoveContainer" containerID="9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1"
Sep 08 00:59:03.190438 ip-10-0-140-137 kubenswrapper[2578]: E0908 00:59:03.190420    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1\": container with ID starting with 9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1 not found: ID does not exist" containerID="9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1"
Sep 08 00:59:03.190484 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.190448    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1"} err="failed to get container status \"9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1\": rpc error: code = NotFound desc = could not find container \"9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1\": container with ID starting with 9df603223b5433f12d2b7f154197c136a5920b7bbed7db59173a59511aac6af1 not found: ID does not exist"
Sep 08 00:59:03.201699 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.201667    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"]
Sep 08 00:59:03.205133 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:03.205113    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-rgbxb"]
Sep 08 00:59:04.057290 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:04.057255    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a39ea65-eecc-422c-897f-d155f8f1f71c" path="/var/lib/kubelet/pods/9a39ea65-eecc-422c-897f-d155f8f1f71c/volumes"
Sep 08 00:59:04.267471 ip-10-0-140-137 kubenswrapper[2578]: I0908 00:59:04.267431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:00:00.826793 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.826757    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"]
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827152    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d585b1a-e1a1-49af-8e33-4fff104530cd" containerName="payload-pre-processing"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827165    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d585b1a-e1a1-49af-8e33-4fff104530cd" containerName="payload-pre-processing"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827175    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827182    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827190    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827197    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827209    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827214    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy"
Sep 08 01:00:00.827214 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827219    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b847d3-9f33-400e-971e-aef8bb394a51" containerName="maas-api"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827225    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b847d3-9f33-400e-971e-aef8bb394a51" containerName="maas-api"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827233    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827239    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827247    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b62b3b-291b-4952-868d-cc8fe4a49415" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827252    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b62b3b-291b-4952-868d-cc8fe4a49415" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827259    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a1d003-0554-4a70-b593-db9433018f2e" containerName="payload-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827264    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a1d003-0554-4a70-b593-db9433018f2e" containerName="payload-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827270    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab836ea-9fe2-4559-9a94-460a7a16062f" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827275    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab836ea-9fe2-4559-9a94-460a7a16062f" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827282    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a39ea65-eecc-422c-897f-d155f8f1f71c" containerName="manager"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827286    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a39ea65-eecc-422c-897f-d155f8f1f71c" containerName="manager"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827296    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827301    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827309    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de07df94-e4e8-49e7-9ed3-b9bda5778e0b" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827314    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="de07df94-e4e8-49e7-9ed3-b9bda5778e0b" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827371    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827379    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827386    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d585b1a-e1a1-49af-8e33-4fff104530cd" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827392    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b847d3-9f33-400e-971e-aef8bb394a51" containerName="maas-api"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827399    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a39ea65-eecc-422c-897f-d155f8f1f71c" containerName="manager"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827409    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827415    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827421    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827426    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="de07df94-e4e8-49e7-9ed3-b9bda5778e0b" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827432    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827438    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b62b3b-291b-4952-868d-cc8fe4a49415" containerName="payload-pre-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827443    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6ceec9-4d7b-4df3-b805-1741b8ecfb7b" containerName="istio-proxy"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827449    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a1d003-0554-4a70-b593-db9433018f2e" containerName="payload-processing"
Sep 08 01:00:00.827503 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.827454    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bab836ea-9fe2-4559-9a94-460a7a16062f" containerName="payload-pre-processing"
Sep 08 01:00:00.830551 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.830532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:00.833517 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.833490    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 01:00:00.833648 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.833563    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 01:00:00.833751 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.833701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ssxq9\""
Sep 08 01:00:00.842646 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.842623    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"]
Sep 08 01:00:00.921030 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.921000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c514b4bb-f9fe-43a6-9de3-044af1af7e5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-p7pj8\" (UID: \"c514b4bb-f9fe-43a6-9de3-044af1af7e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:00.921157 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:00.921069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znlh5\" (UniqueName: \"kubernetes.io/projected/c514b4bb-f9fe-43a6-9de3-044af1af7e5e-kube-api-access-znlh5\") pod \"kuadrant-operator-controller-manager-7456d9997c-p7pj8\" (UID: \"c514b4bb-f9fe-43a6-9de3-044af1af7e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.021940 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.021914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c514b4bb-f9fe-43a6-9de3-044af1af7e5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-p7pj8\" (UID: \"c514b4bb-f9fe-43a6-9de3-044af1af7e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.022045 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.021981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znlh5\" (UniqueName: \"kubernetes.io/projected/c514b4bb-f9fe-43a6-9de3-044af1af7e5e-kube-api-access-znlh5\") pod \"kuadrant-operator-controller-manager-7456d9997c-p7pj8\" (UID: \"c514b4bb-f9fe-43a6-9de3-044af1af7e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.022264 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.022246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c514b4bb-f9fe-43a6-9de3-044af1af7e5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-p7pj8\" (UID: \"c514b4bb-f9fe-43a6-9de3-044af1af7e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.031010 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.030993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znlh5\" (UniqueName: \"kubernetes.io/projected/c514b4bb-f9fe-43a6-9de3-044af1af7e5e-kube-api-access-znlh5\") pod \"kuadrant-operator-controller-manager-7456d9997c-p7pj8\" (UID: \"c514b4bb-f9fe-43a6-9de3-044af1af7e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.142501 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.142444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.420581 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.420551    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"]
Sep 08 01:00:01.422164 ip-10-0-140-137 kubenswrapper[2578]: W0908 01:00:01.422137    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc514b4bb_f9fe_43a6_9de3_044af1af7e5e.slice/crio-b840b271ade948c559e74fef76c3c6cf91b8179a58aa8841fbffe93a898a6357 WatchSource:0}: Error finding container b840b271ade948c559e74fef76c3c6cf91b8179a58aa8841fbffe93a898a6357: Status 404 returned error can't find the container with id b840b271ade948c559e74fef76c3c6cf91b8179a58aa8841fbffe93a898a6357
Sep 08 01:00:01.509445 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.509412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8" event={"ID":"c514b4bb-f9fe-43a6-9de3-044af1af7e5e","Type":"ContainerStarted","Data":"978ffeab96c792c59711577773776ed402aae2148844c4911fa5462ba72276f0"}
Sep 08 01:00:01.509742 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.509496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8" event={"ID":"c514b4bb-f9fe-43a6-9de3-044af1af7e5e","Type":"ContainerStarted","Data":"b840b271ade948c559e74fef76c3c6cf91b8179a58aa8841fbffe93a898a6357"}
Sep 08 01:00:01.509742 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.509557    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:01.531458 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:01.531416    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8" podStartSLOduration=1.5314029599999999 podStartE2EDuration="1.53140296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:00:01.530102999 +0000 UTC m=+1623.908476446" watchObservedRunningTime="2026-09-08 01:00:01.53140296 +0000 UTC m=+1623.909776392"
Sep 08 01:00:12.517197 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:12.517167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-p7pj8"
Sep 08 01:00:46.471671 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:46.471637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:00:51.921030 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.920997    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"]
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921395    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy"
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921405    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="052ac600-556c-4cdb-9233-0332e68cf9d3" containerName="istio-proxy"
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921413    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy"
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921419    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy"
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921432    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy"
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921437    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2daee3-e01e-4d6c-842e-400b65d90649" containerName="istio-proxy"
Sep 08 01:00:51.921509 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.921497    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dc9d80e-7203-4996-89e3-5974f1e216d9" containerName="istio-proxy"
Sep 08 01:00:51.924746 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.924725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:51.927433 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.927406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-8fc557f8-kserve-self-signed-certs\""
Sep 08 01:00:51.935657 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.935623    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"]
Sep 08 01:00:51.960923 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.960893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:00:51.974405 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.974381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-tmp-dir\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:51.974517 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.974438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-dshm\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:51.974517 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.974464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-home\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:51.974517 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.974502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b99be8e-69ee-4490-ace9-50ad91c412ec-tls-certs\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:51.974714 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.974667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-model-cache\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:51.974776 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:51.974760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z96l\" (UniqueName: \"kubernetes.io/projected/1b99be8e-69ee-4490-ace9-50ad91c412ec-kube-api-access-4z96l\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.075859 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.075827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-model-cache\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076061 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.075888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z96l\" (UniqueName: \"kubernetes.io/projected/1b99be8e-69ee-4490-ace9-50ad91c412ec-kube-api-access-4z96l\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076061 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.075988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-tmp-dir\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076061 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.076042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-dshm\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076233 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.076067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-home\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076233 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.076115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b99be8e-69ee-4490-ace9-50ad91c412ec-tls-certs\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076344 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.076239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-model-cache\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076523 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.076497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-tmp-dir\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.076906 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.076880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-home\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.078519 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.078498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-dshm\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.078677 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.078659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b99be8e-69ee-4490-ace9-50ad91c412ec-tls-certs\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.084742 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.084716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z96l\" (UniqueName: \"kubernetes.io/projected/1b99be8e-69ee-4490-ace9-50ad91c412ec-kube-api-access-4z96l\") pod \"e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") " pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.240075 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.239772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:00:52.512302 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.512274    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"]
Sep 08 01:00:52.513881 ip-10-0-140-137 kubenswrapper[2578]: W0908 01:00:52.513853    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b99be8e_69ee_4490_ace9_50ad91c412ec.slice/crio-96178c8dafcc8bbf650392d76df422dbb8ba0356139db3b62d1e0f0c4ac0ee99 WatchSource:0}: Error finding container 96178c8dafcc8bbf650392d76df422dbb8ba0356139db3b62d1e0f0c4ac0ee99: Status 404 returned error can't find the container with id 96178c8dafcc8bbf650392d76df422dbb8ba0356139db3b62d1e0f0c4ac0ee99
Sep 08 01:00:52.780591 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.780494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" event={"ID":"1b99be8e-69ee-4490-ace9-50ad91c412ec","Type":"ContainerStarted","Data":"c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af"}
Sep 08 01:00:52.780591 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.780546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" event={"ID":"1b99be8e-69ee-4490-ace9-50ad91c412ec","Type":"ContainerStarted","Data":"96178c8dafcc8bbf650392d76df422dbb8ba0356139db3b62d1e0f0c4ac0ee99"}
Sep 08 01:00:52.796074 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:52.796002    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" podStartSLOduration=1.795985039 podStartE2EDuration="1.795985039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:00:52.795043727 +0000 UTC m=+1675.173417172" watchObservedRunningTime="2026-09-08 01:00:52.795985039 +0000 UTC m=+1675.174358471"
Sep 08 01:00:53.240042 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:00:53.239996    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:01:02.240157 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:02.240118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:01:02.252646 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:02.252622    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:01:02.849030 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:02.848998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:01:22.997111 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:22.997032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:01:23.098979 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:23.098930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:01:23.256601 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:23.256504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:01:25.711592 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:25.711555    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"]
Sep 08 01:01:25.733852 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:25.733813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:01:40.744544 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:40.744507    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" podUID="1b99be8e-69ee-4490-ace9-50ad91c412ec" containerName="main" containerID="cri-o://c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af" gracePeriod=45
Sep 08 01:01:40.836024 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:40.835989    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" podUID="1b99be8e-69ee-4490-ace9-50ad91c412ec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.74:8000/ready\": dial tcp 10.133.0.74:8000: connect: connection refused"
Sep 08 01:01:40.999563 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:40.999503    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:01:41.044572 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.044543    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b99be8e-69ee-4490-ace9-50ad91c412ec" containerID="c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af" exitCode=0
Sep 08 01:01:41.044719 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.044576    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"
Sep 08 01:01:41.044719 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.044628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" event={"ID":"1b99be8e-69ee-4490-ace9-50ad91c412ec","Type":"ContainerDied","Data":"c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af"}
Sep 08 01:01:41.044719 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.044677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7" event={"ID":"1b99be8e-69ee-4490-ace9-50ad91c412ec","Type":"ContainerDied","Data":"96178c8dafcc8bbf650392d76df422dbb8ba0356139db3b62d1e0f0c4ac0ee99"}
Sep 08 01:01:41.044848 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.044719    2578 scope.go:117] "RemoveContainer" containerID="c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af"
Sep 08 01:01:41.053357 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.053333    2578 scope.go:117] "RemoveContainer" containerID="c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af"
Sep 08 01:01:41.053640 ip-10-0-140-137 kubenswrapper[2578]: E0908 01:01:41.053623    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af\": container with ID starting with c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af not found: ID does not exist" containerID="c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af"
Sep 08 01:01:41.053742 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.053647    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af"} err="failed to get container status \"c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af\": rpc error: code = NotFound desc = could not find container \"c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af\": container with ID starting with c4669346161192bb23ddf6f70678e5ec807276b03e8f8696959d2c7806d994af not found: ID does not exist"
Sep 08 01:01:41.139299 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-tmp-dir\") pod \"1b99be8e-69ee-4490-ace9-50ad91c412ec\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") "
Sep 08 01:01:41.139419 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139318    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-dshm\") pod \"1b99be8e-69ee-4490-ace9-50ad91c412ec\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") "
Sep 08 01:01:41.139419 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139350    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z96l\" (UniqueName: \"kubernetes.io/projected/1b99be8e-69ee-4490-ace9-50ad91c412ec-kube-api-access-4z96l\") pod \"1b99be8e-69ee-4490-ace9-50ad91c412ec\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") "
Sep 08 01:01:41.139419 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139378    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-home\") pod \"1b99be8e-69ee-4490-ace9-50ad91c412ec\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") "
Sep 08 01:01:41.139419 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-model-cache\") pod \"1b99be8e-69ee-4490-ace9-50ad91c412ec\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") "
Sep 08 01:01:41.139642 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139494    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b99be8e-69ee-4490-ace9-50ad91c412ec-tls-certs\") pod \"1b99be8e-69ee-4490-ace9-50ad91c412ec\" (UID: \"1b99be8e-69ee-4490-ace9-50ad91c412ec\") "
Sep 08 01:01:41.139642 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139561    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b99be8e-69ee-4490-ace9-50ad91c412ec" (UID: "1b99be8e-69ee-4490-ace9-50ad91c412ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 01:01:41.139768 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-home" (OuterVolumeSpecName: "home") pod "1b99be8e-69ee-4490-ace9-50ad91c412ec" (UID: "1b99be8e-69ee-4490-ace9-50ad91c412ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 01:01:41.139768 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.139745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b99be8e-69ee-4490-ace9-50ad91c412ec" (UID: "1b99be8e-69ee-4490-ace9-50ad91c412ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 01:01:41.140082 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.140060    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-model-cache\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:01:41.140167 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.140086    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-tmp-dir\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:01:41.140167 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.140112    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-home\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:01:41.141626 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.141599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-dshm" (OuterVolumeSpecName: "dshm") pod "1b99be8e-69ee-4490-ace9-50ad91c412ec" (UID: "1b99be8e-69ee-4490-ace9-50ad91c412ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 01:01:41.141626 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.141620    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b99be8e-69ee-4490-ace9-50ad91c412ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b99be8e-69ee-4490-ace9-50ad91c412ec" (UID: "1b99be8e-69ee-4490-ace9-50ad91c412ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 01:01:41.141812 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.141619    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b99be8e-69ee-4490-ace9-50ad91c412ec-kube-api-access-4z96l" (OuterVolumeSpecName: "kube-api-access-4z96l") pod "1b99be8e-69ee-4490-ace9-50ad91c412ec" (UID: "1b99be8e-69ee-4490-ace9-50ad91c412ec"). InnerVolumeSpecName "kube-api-access-4z96l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 01:01:41.241524 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.241502    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b99be8e-69ee-4490-ace9-50ad91c412ec-tls-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:01:41.241524 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.241523    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b99be8e-69ee-4490-ace9-50ad91c412ec-dshm\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:01:41.241658 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.241531    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z96l\" (UniqueName: \"kubernetes.io/projected/1b99be8e-69ee-4490-ace9-50ad91c412ec-kube-api-access-4z96l\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:01:41.369421 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.369367    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"]
Sep 08 01:01:41.375010 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:41.373714    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-8fc557f8-kserve-5cd585bf88-5glv7"]
Sep 08 01:01:42.056531 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:42.056500    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b99be8e-69ee-4490-ace9-50ad91c412ec" path="/var/lib/kubelet/pods/1b99be8e-69ee-4490-ace9-50ad91c412ec/volumes"
Sep 08 01:01:51.843998 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:51.843962    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"]
Sep 08 01:01:51.844431 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:51.844416    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b99be8e-69ee-4490-ace9-50ad91c412ec" containerName="main"
Sep 08 01:01:51.844491 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:51.844434    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b99be8e-69ee-4490-ace9-50ad91c412ec" containerName="main"
Sep 08 01:01:51.844534 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:51.844491    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b99be8e-69ee-4490-ace9-50ad91c412ec" containerName="main"
Sep 08 01:01:51.849182 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:51.849164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:51.859368 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:51.859345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"]
Sep 08 01:01:52.033936 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.033907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f757207a-41d9-4c60-86da-d610a546feb9-openshift-service-ca\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.034092 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.033951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f757207a-41d9-4c60-86da-d610a546feb9-maas-api-tls\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.034092 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.033981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wf5l\" (UniqueName: \"kubernetes.io/projected/f757207a-41d9-4c60-86da-d610a546feb9-kube-api-access-5wf5l\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.034092 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.034024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f757207a-41d9-4c60-86da-d610a546feb9-metrics-certs\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.134833 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.134758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f757207a-41d9-4c60-86da-d610a546feb9-metrics-certs\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.134973 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.134852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f757207a-41d9-4c60-86da-d610a546feb9-openshift-service-ca\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.134973 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.134888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f757207a-41d9-4c60-86da-d610a546feb9-maas-api-tls\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.134973 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.134913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wf5l\" (UniqueName: \"kubernetes.io/projected/f757207a-41d9-4c60-86da-d610a546feb9-kube-api-access-5wf5l\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.135540 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.135514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f757207a-41d9-4c60-86da-d610a546feb9-openshift-service-ca\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.137145 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.137123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f757207a-41d9-4c60-86da-d610a546feb9-metrics-certs\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.137308 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.137287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f757207a-41d9-4c60-86da-d610a546feb9-maas-api-tls\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.141924 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.141901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wf5l\" (UniqueName: \"kubernetes.io/projected/f757207a-41d9-4c60-86da-d610a546feb9-kube-api-access-5wf5l\") pod \"maas-api-f695cf7ff-z8cxz\" (UID: \"f757207a-41d9-4c60-86da-d610a546feb9\") " pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.162933 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.162912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:52.433300 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.433270    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"]
Sep 08 01:01:52.435099 ip-10-0-140-137 kubenswrapper[2578]: W0908 01:01:52.435075    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf757207a_41d9_4c60_86da_d610a546feb9.slice/crio-717131a06792980f4be46c3729f54f6ece3e465d0893eed1db6db0dcfe22db94 WatchSource:0}: Error finding container 717131a06792980f4be46c3729f54f6ece3e465d0893eed1db6db0dcfe22db94: Status 404 returned error can't find the container with id 717131a06792980f4be46c3729f54f6ece3e465d0893eed1db6db0dcfe22db94
Sep 08 01:01:52.436811 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:52.436795    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 01:01:53.118716 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:53.118602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz" event={"ID":"f757207a-41d9-4c60-86da-d610a546feb9","Type":"ContainerStarted","Data":"1d4f0c799ee700ce9a7203d27a7453501645d99559c9647f8137b3ab87ce5f86"}
Sep 08 01:01:53.118716 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:53.118706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz" event={"ID":"f757207a-41d9-4c60-86da-d610a546feb9","Type":"ContainerStarted","Data":"717131a06792980f4be46c3729f54f6ece3e465d0893eed1db6db0dcfe22db94"}
Sep 08 01:01:53.119173 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:53.118735    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:01:53.136517 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:53.136472    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz" podStartSLOduration=1.761750201 podStartE2EDuration="2.13645859s" totalImagesPullingTime="374.708389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:01:53.13410592 +0000 UTC m=+1735.512479346" watchObservedRunningTime="2026-09-08 01:01:53.13645859 +0000 UTC m=+1735.514832030"
Sep 08 01:01:59.131971 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:01:59.131935    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f695cf7ff-z8cxz"
Sep 08 01:02:06.898946 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:06.898898    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"]
Sep 08 01:02:06.899420 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:06.899115    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" podUID="a311d76d-d02d-454b-a761-c77b609cb02a" containerName="maas-api" containerID="cri-o://3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125" gracePeriod=30
Sep 08 01:02:06.978971 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:06.978933    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" podUID="a311d76d-d02d-454b-a761-c77b609cb02a" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
Sep 08 01:02:08.143212 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.143190    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 01:02:08.199867 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.199837    2578 generic.go:356] "Generic (PLEG): container finished" podID="a311d76d-d02d-454b-a761-c77b609cb02a" containerID="3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125" exitCode=0
Sep 08 01:02:08.200020 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.199877    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"
Sep 08 01:02:08.200020 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.199885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" event={"ID":"a311d76d-d02d-454b-a761-c77b609cb02a","Type":"ContainerDied","Data":"3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125"}
Sep 08 01:02:08.200020 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.199925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6dcd549895-vszfm" event={"ID":"a311d76d-d02d-454b-a761-c77b609cb02a","Type":"ContainerDied","Data":"2f2c93eb453868b98c9bd25f25a69dea99531dda4c67ee35e7431177d72966a2"}
Sep 08 01:02:08.200020 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.199951    2578 scope.go:117] "RemoveContainer" containerID="3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125"
Sep 08 01:02:08.208529 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.208511    2578 scope.go:117] "RemoveContainer" containerID="3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125"
Sep 08 01:02:08.208803 ip-10-0-140-137 kubenswrapper[2578]: E0908 01:02:08.208784    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125\": container with ID starting with 3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125 not found: ID does not exist" containerID="3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125"
Sep 08 01:02:08.208853 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.208812    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125"} err="failed to get container status \"3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125\": rpc error: code = NotFound desc = could not find container \"3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125\": container with ID starting with 3abaf707b9ebf92fb6532046b4eac1dedc24cf5a25fcd97f95d550db35bc5125 not found: ID does not exist"
Sep 08 01:02:08.273710 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.273671    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-metrics-certs\") pod \"a311d76d-d02d-454b-a761-c77b609cb02a\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") "
Sep 08 01:02:08.273814 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.273727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a311d76d-d02d-454b-a761-c77b609cb02a-openshift-service-ca\") pod \"a311d76d-d02d-454b-a761-c77b609cb02a\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") "
Sep 08 01:02:08.273814 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.273795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-maas-api-tls\") pod \"a311d76d-d02d-454b-a761-c77b609cb02a\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") "
Sep 08 01:02:08.273940 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.273894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56vmt\" (UniqueName: \"kubernetes.io/projected/a311d76d-d02d-454b-a761-c77b609cb02a-kube-api-access-56vmt\") pod \"a311d76d-d02d-454b-a761-c77b609cb02a\" (UID: \"a311d76d-d02d-454b-a761-c77b609cb02a\") "
Sep 08 01:02:08.274153 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.274125    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a311d76d-d02d-454b-a761-c77b609cb02a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a311d76d-d02d-454b-a761-c77b609cb02a" (UID: "a311d76d-d02d-454b-a761-c77b609cb02a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 01:02:08.274260 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.274246    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a311d76d-d02d-454b-a761-c77b609cb02a-openshift-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:02:08.276231 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.276201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a311d76d-d02d-454b-a761-c77b609cb02a" (UID: "a311d76d-d02d-454b-a761-c77b609cb02a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 01:02:08.276346 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.276324    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a311d76d-d02d-454b-a761-c77b609cb02a-kube-api-access-56vmt" (OuterVolumeSpecName: "kube-api-access-56vmt") pod "a311d76d-d02d-454b-a761-c77b609cb02a" (UID: "a311d76d-d02d-454b-a761-c77b609cb02a"). InnerVolumeSpecName "kube-api-access-56vmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 01:02:08.276413 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.276352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a311d76d-d02d-454b-a761-c77b609cb02a" (UID: "a311d76d-d02d-454b-a761-c77b609cb02a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 01:02:08.375504 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.375464    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56vmt\" (UniqueName: \"kubernetes.io/projected/a311d76d-d02d-454b-a761-c77b609cb02a-kube-api-access-56vmt\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:02:08.375504 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.375504    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-metrics-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:02:08.375791 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.375520    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a311d76d-d02d-454b-a761-c77b609cb02a-maas-api-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\""
Sep 08 01:02:08.525853 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.525825    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"]
Sep 08 01:02:08.530058 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:08.530032    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6dcd549895-vszfm"]
Sep 08 01:02:10.057518 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:10.057486    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a311d76d-d02d-454b-a761-c77b609cb02a" path="/var/lib/kubelet/pods/a311d76d-d02d-454b-a761-c77b609cb02a/volumes"
Sep 08 01:02:12.502307 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:12.502265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:02:46.432227 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:46.432193    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-t22vw_9a2f776c-1358-424d-b1ec-453000aaeead/manager/0.log"
Sep 08 01:02:46.547769 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:46.547734    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-jh7pn_fddc769e-7610-43ee-b473-88fa32c73f0b/manager/0.log"
Sep 08 01:02:46.770427 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:46.770347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-xqsrp_8ebbdc0b-0937-48f0-8458-a8f848c66ed0/server/0.log"
Sep 08 01:02:47.329904 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:47.329873    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f695cf7ff-z8cxz_f757207a-41d9-4c60-86da-d610a546feb9/maas-api/0.log"
Sep 08 01:02:47.658263 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:47.658177    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-b9k4q_963ee435-2bde-48e3-aa23-419ea8dd28f7/postgres/0.log"
Sep 08 01:02:48.857304 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:48.857271    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-p7pj8_c514b4bb-f9fe-43a6-9de3-044af1af7e5e/manager/0.log"
Sep 08 01:02:49.412110 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:49.412078    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2_ec363603-2e3e-4fe7-bf3d-df6f5c902d7c/istio-proxy/0.log"
Sep 08 01:02:49.849725 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:49.849696    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/1.log"
Sep 08 01:02:49.955885 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:49.955856    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2_f8a8673a-3424-45c3-98d1-323473d7a065/istio-proxy/0.log"
Sep 08 01:02:50.193548 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:50.193470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-np5lm_6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf/payload-processing/0.log"
Sep 08 01:02:50.302561 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:50.302534    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9cc55c7b-ftdm6_27a21748-8b18-4b65-be93-98f3dcb9d82e/router/0.log"
Sep 08 01:02:50.624732 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:50.624657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-5fc5ddd44f-cmhkr_02feb397-35dc-43f3-8607-9c033d2efe5d/main/0.log"
Sep 08 01:02:50.731538 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:50.731513    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5d57fc946d-bd8pf_56d175c7-acd6-4615-b7fb-03ee8df625b2/main/0.log"
Sep 08 01:02:50.842696 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:50.842668    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-698db7d589-hx7d7_625a1d19-6b03-4e7c-9347-c3cf244605c2/main/0.log"
Sep 08 01:02:50.949457 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:50.949399    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-5bccb7bbf7-62b8l_23a2cdda-1a6b-4cb1-a67b-c3e2b2d2219b/main/0.log"
Sep 08 01:02:56.594872 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:56.594818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:02:56.708806 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:56.708767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:02:59.448714 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:59.448670    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d6x5s_bcb104ac-6bd5-48fa-998a-ca4b60684918/global-pull-secret-syncer/0.log"
Sep 08 01:02:59.589096 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:59.589060    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log"
Sep 08 01:02:59.713198 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:02:59.713121    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-137.ec2.internal_3aa92973b9fc245d1f83164656b4e586/haproxy/0.log"
Sep 08 01:03:04.799141 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:04.799103    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-p7pj8_c514b4bb-f9fe-43a6-9de3-044af1af7e5e/manager/0.log"
Sep 08 01:03:06.439350 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.439322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/alertmanager/0.log"
Sep 08 01:03:06.478637 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.478615    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/config-reloader/0.log"
Sep 08 01:03:06.521215 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.521192    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/kube-rbac-proxy-web/0.log"
Sep 08 01:03:06.549966 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.549941    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/kube-rbac-proxy/0.log"
Sep 08 01:03:06.572572 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.572548    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/kube-rbac-proxy-metric/0.log"
Sep 08 01:03:06.595590 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.595533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/prom-label-proxy/0.log"
Sep 08 01:03:06.624669 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.624650    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0aef09d0-21cc-42f7-bf2b-156ad1b90629/init-config-reloader/0.log"
Sep 08 01:03:06.825083 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.825057    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-869d6bd57-sfqmz_6b0f08b9-15b0-45fa-b81e-7b9e43098607/metrics-server/0.log"
Sep 08 01:03:06.913099 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.913017    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-42vgw_926b6458-2e58-4f51-8bd7-5b1996da9b91/node-exporter/0.log"
Sep 08 01:03:06.947191 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.947154    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-42vgw_926b6458-2e58-4f51-8bd7-5b1996da9b91/kube-rbac-proxy/0.log"
Sep 08 01:03:06.982236 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:06.982212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-42vgw_926b6458-2e58-4f51-8bd7-5b1996da9b91/init-textfile/0.log"
Sep 08 01:03:07.478089 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:07.478057    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-tplc4_b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1/prometheus-operator/0.log"
Sep 08 01:03:07.500439 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:07.500412    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-tplc4_b0cbbd5e-69ca-4d88-ab51-ba3f76a88fb1/kube-rbac-proxy/0.log"
Sep 08 01:03:09.223857 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.223825    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"]
Sep 08 01:03:09.224231 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.224213    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a311d76d-d02d-454b-a761-c77b609cb02a" containerName="maas-api"
Sep 08 01:03:09.224231 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.224227    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a311d76d-d02d-454b-a761-c77b609cb02a" containerName="maas-api"
Sep 08 01:03:09.224308 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.224302    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a311d76d-d02d-454b-a761-c77b609cb02a" containerName="maas-api"
Sep 08 01:03:09.227295 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.227280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.229642 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.229621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2vwnw\"/\"default-dockercfg-ptf2h\""
Sep 08 01:03:09.229814 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.229624    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2vwnw\"/\"openshift-service-ca.crt\""
Sep 08 01:03:09.230419 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.230403    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2vwnw\"/\"kube-root-ca.crt\""
Sep 08 01:03:09.236943 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.236923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"]
Sep 08 01:03:09.318984 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.318964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-lib-modules\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.319094 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.318996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb28j\" (UniqueName: \"kubernetes.io/projected/73b1e472-8199-4f21-89af-cf0e0f3b2247-kube-api-access-pb28j\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.319094 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.319023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-sys\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.319183 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.319120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-proc\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.319183 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.319161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-podres\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420105 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-lib-modules\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420218 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb28j\" (UniqueName: \"kubernetes.io/projected/73b1e472-8199-4f21-89af-cf0e0f3b2247-kube-api-access-pb28j\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420218 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-sys\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420218 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-proc\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420380 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-podres\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420380 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-lib-modules\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420380 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-sys\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420380 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-proc\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.420380 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.420320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73b1e472-8199-4f21-89af-cf0e0f3b2247-podres\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.427226 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.427204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb28j\" (UniqueName: \"kubernetes.io/projected/73b1e472-8199-4f21-89af-cf0e0f3b2247-kube-api-access-pb28j\") pod \"perf-node-gather-daemonset-k27c9\" (UID: \"73b1e472-8199-4f21-89af-cf0e0f3b2247\") " pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.537956 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.537890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:09.814424 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:09.814397    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"]
Sep 08 01:03:09.816611 ip-10-0-140-137 kubenswrapper[2578]: W0908 01:03:09.816574    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod73b1e472_8199_4f21_89af_cf0e0f3b2247.slice/crio-acbdcba1b96676c2af438bc0b23062a4f907f46cd7da0da41b66d887f8ed25f8 WatchSource:0}: Error finding container acbdcba1b96676c2af438bc0b23062a4f907f46cd7da0da41b66d887f8ed25f8: Status 404 returned error can't find the container with id acbdcba1b96676c2af438bc0b23062a4f907f46cd7da0da41b66d887f8ed25f8
Sep 08 01:03:10.106713 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:10.106636    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cb57d9f96-chkgz_181f802f-92eb-4070-82e2-520ef12a4648/console/0.log"
Sep 08 01:03:10.545976 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:10.545931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9" event={"ID":"73b1e472-8199-4f21-89af-cf0e0f3b2247","Type":"ContainerStarted","Data":"585ea6301b865ea6f3def996396c5aa3fcce4ffdf6e79fb29a4b0011b6274226"}
Sep 08 01:03:10.546398 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:10.546007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9" event={"ID":"73b1e472-8199-4f21-89af-cf0e0f3b2247","Type":"ContainerStarted","Data":"acbdcba1b96676c2af438bc0b23062a4f907f46cd7da0da41b66d887f8ed25f8"}
Sep 08 01:03:10.546398 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:10.546111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:10.563074 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:10.563030    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9" podStartSLOduration=1.563015364 podStartE2EDuration="1.563015364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:03:10.562343547 +0000 UTC m=+1812.940716980" watchObservedRunningTime="2026-09-08 01:03:10.563015364 +0000 UTC m=+1812.941388797"
Sep 08 01:03:11.962452 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:11.962418    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkkwj_8dd25b20-51e3-4402-a5c6-7697c70d628c/dns/0.log"
Sep 08 01:03:12.013113 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:12.013087    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkkwj_8dd25b20-51e3-4402-a5c6-7697c70d628c/kube-rbac-proxy/0.log"
Sep 08 01:03:12.069737 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:12.069713    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lk8hz_2e336deb-8a67-4a1a-9bec-3d76fb74379f/dns-node-resolver/0.log"
Sep 08 01:03:12.614958 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:12.614922    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-785fd6f58b-d7zx5_8d12f530-c546-4432-9344-4fe8f842d88c/registry/0.log"
Sep 08 01:03:12.683754 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:12.683720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xs92k_8f195f69-0b1a-472a-9ff6-a522a7240933/node-ca/0.log"
Sep 08 01:03:13.638644 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:13.638616    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2_ec363603-2e3e-4fe7-bf3d-df6f5c902d7c/istio-proxy/0.log"
Sep 08 01:03:14.091332 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:14.091291    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/0.log"
Sep 08 01:03:14.111078 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:14.111045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/1.log"
Sep 08 01:03:14.138766 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:14.138745    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2_f8a8673a-3424-45c3-98d1-323473d7a065/istio-proxy/0.log"
Sep 08 01:03:14.237442 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:14.237403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-np5lm_6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf/payload-processing/0.log"
Sep 08 01:03:14.261817 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:14.261793    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9cc55c7b-ftdm6_27a21748-8b18-4b65-be93-98f3dcb9d82e/router/0.log"
Sep 08 01:03:15.119247 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:15.119208    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tjn4t_ce714838-8311-4acb-8929-bc569891295a/serve-healthcheck-canary/0.log"
Sep 08 01:03:15.605040 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:15.605013    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-gsj8b_05f1c2bd-2476-4475-8c88-62e9c5249322/insights-operator/0.log"
Sep 08 01:03:15.605322 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:15.605304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-gsj8b_05f1c2bd-2476-4475-8c88-62e9c5249322/insights-operator/1.log"
Sep 08 01:03:15.777310 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:15.777281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lw2bk_e3fadda5-226a-4df2-91d3-3193d735007f/kube-rbac-proxy/0.log"
Sep 08 01:03:15.798265 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:15.798222    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lw2bk_e3fadda5-226a-4df2-91d3-3193d735007f/exporter/0.log"
Sep 08 01:03:15.820985 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:15.820961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lw2bk_e3fadda5-226a-4df2-91d3-3193d735007f/extractor/0.log"
Sep 08 01:03:16.562195 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:16.562167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2vwnw/perf-node-gather-daemonset-k27c9"
Sep 08 01:03:18.219899 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:18.219872    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7c7d4c4566-hzgkh_94503909-6235-4430-a059-d6ecba6a2b22/manager/0.log"
Sep 08 01:03:18.249178 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:18.249146    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7c7d4c4566-hzgkh_94503909-6235-4430-a059-d6ecba6a2b22/copy-manifests/0.log"
Sep 08 01:03:18.570897 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:18.570870    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2_ec363603-2e3e-4fe7-bf3d-df6f5c902d7c/istio-proxy/0.log"
Sep 08 01:03:19.005489 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:19.005448    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/0.log"
Sep 08 01:03:19.025162 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:19.025131    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/1.log"
Sep 08 01:03:19.038368 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:19.038346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2_f8a8673a-3424-45c3-98d1-323473d7a065/istio-proxy/0.log"
Sep 08 01:03:19.119984 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:19.119957    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-np5lm_6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf/payload-processing/0.log"
Sep 08 01:03:19.141264 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:19.141212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9cc55c7b-ftdm6_27a21748-8b18-4b65-be93-98f3dcb9d82e/router/0.log"
Sep 08 01:03:20.512622 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:20.512597    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-t22vw_9a2f776c-1358-424d-b1ec-453000aaeead/manager/0.log"
Sep 08 01:03:20.638774 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:20.638674    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r2xt2_ec363603-2e3e-4fe7-bf3d-df6f5c902d7c/istio-proxy/0.log"
Sep 08 01:03:20.692876 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:20.692850    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-jh7pn_fddc769e-7610-43ee-b473-88fa32c73f0b/manager/0.log"
Sep 08 01:03:20.779408 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:20.779380    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-xqsrp_8ebbdc0b-0937-48f0-8458-a8f848c66ed0/server/0.log"
Sep 08 01:03:21.051450 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:21.051419    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/0.log"
Sep 08 01:03:21.070181 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:21.070159    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rwdt9_edcd4584-56dc-4162-9f47-36784db854cc/istio-proxy/1.log"
Sep 08 01:03:21.087174 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:21.087141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-rw2p2_f8a8673a-3424-45c3-98d1-323473d7a065/istio-proxy/0.log"
Sep 08 01:03:21.164382 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:21.164357    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-np5lm_6efa673d-1a39-46e7-ae43-c6bb0fb0d5bf/payload-processing/0.log"
Sep 08 01:03:21.179952 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:21.179928    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9cc55c7b-ftdm6_27a21748-8b18-4b65-be93-98f3dcb9d82e/router/0.log"
Sep 08 01:03:26.012467 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:26.012363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024
Sep 08 01:03:26.071572 ip-10-0-140-137 kubenswrapper[2578]: I0908 01:03:26.071535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbzh9_bd2536de-4cb8-43ef-9803-ce2d2480b7c5/konnectivity-agent/0.log" limit=1024